2024.09.24 01:43:23.621732 [ 521 ] {} <Warning> Context: ThreadFuzzer is enabled. Application will run slowly and unstable.
2024.09.24 01:43:23.621823 [ 521 ] {} <Warning> Context: Server was built with sanitizer. It will work slowly.
2024.09.24 01:43:23.626112 [ 521 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2024.09.24 01:44:01.276066 [ 521 ] {} <Warning> Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182
2024.09.24 01:44:02.576863 [ 521 ] {} <Warning> KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper.
2024.09.24 01:44:02.577558 [ 521 ] {} <Warning> KeeperLogStore: Removing all changelogs
2024.09.24 01:44:02.579309 [ 521 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2024.09.24 01:44:02.582205 [ 521 ] {} <Warning> KeeperStateManager: No state was read
2024.09.24 01:44:02.582265 [ 521 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2024.09.24 01:44:02.582310 [ 521 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2024.09.24 01:44:02.633219 [ 902 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2024.09.24 01:44:02.701057 [ 521 ] {} <Warning> Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist
2024.09.24 01:44:02.701119 [ 521 ] {} <Warning> Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/
2024.09.24 01:44:03.978119 [ 521 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2024.09.24 01:44:56.800734 [ 1043 ] {} <Error> ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<String>::type>, unsigned long&, String&&) @ 0x0000000009e5faf9 in /usr/bin/clickhouse
3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x0000000009e5f73c in /usr/bin/clickhouse
4. ./build_docker/./src/Common/TransformEndianness.hpp:18: Coordination::ZooKeeper::receiveEvent() @ 0x000000003fb2af6b in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb29f22 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fa1df042ac3 in ?
10. ? @ 0x00007fa1df0d4850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 01:44:57.035755 [ 1042 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:60838 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x000000003fad6b27 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:647: Coordination::ZooKeeper::sendThread() @ 0x000000003fb28069 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3d972 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fa1df042ac3 in ?
10. ? @ 0x00007fa1df0d4850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 01:44:57.897671 [ 1043 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:0: Poco::IOException::IOException(String const&, int) @ 0x000000004a1dd86e in /usr/bin/clickhouse
2. ./build_docker/./base/poco/Net/src/NetException.cpp:0: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000049d4608e in /usr/bin/clickhouse
3. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000049d633fa in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::shutdown() @ 0x0000000049d68359 in /usr/bin/clickhouse
5. ./build_docker/./base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x0000000049d7300e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:969: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000003fb16f0f in /usr/bin/clickhouse
7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb2aa8e in /usr/bin/clickhouse
8. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fa1df042ac3 in ?
12. ? @ 0x00007fa1df0d4850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 01:45:49.957829 [ 521 ] {} <Warning> KeeperLogStore: Changelog is shut down
2024.09.24 01:45:53.243068 [ 1102 ] {} <Warning> Context: ThreadFuzzer is enabled. Application will run slowly and unstable.
2024.09.24 01:45:53.243152 [ 1102 ] {} <Warning> Context: Server was built with sanitizer. It will work slowly.
2024.09.24 01:45:53.247579 [ 1102 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2024.09.24 01:46:34.889644 [ 1102 ] {} <Warning> Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182
2024.09.24 01:46:36.446030 [ 1102 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2024.09.24 01:46:36.449275 [ 1102 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2024.09.24 01:46:36.449335 [ 1102 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2024.09.24 01:46:36.500213 [ 1501 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2024.09.24 01:46:38.791069 [ 1102 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2024.09.24 01:47:31.385572 [ 1621 ] {} <Error> ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<String>::type>, unsigned long&, String&&) @ 0x0000000009e5faf9 in /usr/bin/clickhouse
3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x0000000009e5f73c in /usr/bin/clickhouse
4. ./build_docker/./src/Common/TransformEndianness.hpp:18: Coordination::ZooKeeper::receiveEvent() @ 0x000000003fb2af6b in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb29f22 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fd97af7eac3 in ?
10. ? @ 0x00007fd97b010850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 01:47:31.904435 [ 1631 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:47198 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x000000003fad6b27 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:647: Coordination::ZooKeeper::sendThread() @ 0x000000003fb28069 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3d972 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fd97af7eac3 in ?
10. ? @ 0x00007fd97b010850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 01:47:32.850491 [ 1621 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:0: Poco::IOException::IOException(String const&, int) @ 0x000000004a1dd86e in /usr/bin/clickhouse
2. ./build_docker/./base/poco/Net/src/NetException.cpp:0: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000049d4608e in /usr/bin/clickhouse
3. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000049d633fa in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::shutdown() @ 0x0000000049d68359 in /usr/bin/clickhouse
5. ./build_docker/./base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x0000000049d7300e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:969: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000003fb16f0f in /usr/bin/clickhouse
7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb2aa8e in /usr/bin/clickhouse
8. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fd97af7eac3 in ?
12. ? @ 0x00007fd97b010850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 01:54:45.715997 [ 1535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_1_121_24}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x000000002089312c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000002088e69d in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x00000000207ac6df in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ThreadFuzzer.cpp:242: DB::ThreadFuzzer::maybeInjectMemoryLimitException() @ 0x00000000209420d6 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003dacefcf in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc15 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fd97af7eac3 in ?
17. ? @ 0x00007fd97b010850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:11:47.706833 [ 1523 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_1_371_107}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x000000002089312c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000002088e69d in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x00000000207ac6df in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ThreadFuzzer.cpp:242: DB::ThreadFuzzer::maybeInjectMemoryLimitException() @ 0x00000000209420d6 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003dacefcf in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc15 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fd97af7eac3 in ?
17. ? @ 0x00007fd97b010850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:14:11.818988 [ 1532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_1_181_36}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x000000002089312c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000002088e69d in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x00000000207ac6df in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ThreadFuzzer.cpp:242: DB::ThreadFuzzer::maybeInjectMemoryLimitException() @ 0x00000000209420d6 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003dacefcf in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc15 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fd97af7eac3 in ?
17. ? @ 0x00007fd97b010850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:20:29.322826 [ 1532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_1_494_207}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x000000002089312c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000002088e69d in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x00000000207ac6df in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ThreadFuzzer.cpp:242: DB::ThreadFuzzer::maybeInjectMemoryLimitException() @ 0x00000000209420d6 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003dacefcf in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc15 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fd97af7eac3 in ?
17. ? @ 0x00007fd97b010850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:21:05.259902 [ 1527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_1_503_216}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x000000002089312c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000002088e69d in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x00000000207ac6df in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ThreadFuzzer.cpp:242: DB::ThreadFuzzer::maybeInjectMemoryLimitException() @ 0x00000000209420d6 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003dacefcf in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc15 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fd97af7eac3 in ?
17. ? @ 0x00007fd97b010850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:23:24.122318 [ 1505 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2024.09.24 02:23:24.133413 [ 1500 ] {} <Warning> KeeperLogStore: Raft server is not set in LogStore.
2024.09.24 02:23:24.153941 [ 1102 ] {} <Warning> KeeperLogStore: Changelog is shut down
2024.09.24 02:23:27.439097 [ 2113 ] {} <Warning> Context: ThreadFuzzer is enabled. Application will run slowly and unstable.
2024.09.24 02:23:27.439181 [ 2113 ] {} <Warning> Context: Server was built with sanitizer. It will work slowly.
2024.09.24 02:23:27.439378 [ 2113 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2024.09.24 02:23:27.443711 [ 2113 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2024.09.24 02:24:07.306070 [ 2113 ] {} <Warning> Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182
2024.09.24 02:24:09.244032 [ 2113 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2024.09.24 02:24:09.247542 [ 2113 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2024.09.24 02:24:09.247615 [ 2113 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2024.09.24 02:24:09.298698 [ 2505 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2024.09.24 02:24:12.507760 [ 2113 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2024.09.24 02:25:07.464782 [ 2697 ] {} <Error> ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<String>::type>, unsigned long&, String&&) @ 0x0000000009e5faf9 in /usr/bin/clickhouse
3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x0000000009e5f73c in /usr/bin/clickhouse
4. ./build_docker/./src/Common/TransformEndianness.hpp:18: Coordination::ZooKeeper::receiveEvent() @ 0x000000003fb2af6b in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb29f22 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:07.665724 [ 2664 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:37132 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x000000003fad6b27 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:647: Coordination::ZooKeeper::sendThread() @ 0x000000003fb28069 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3d972 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:08.458166 [ 2697 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:0: Poco::IOException::IOException(String const&, int) @ 0x000000004a1dd86e in /usr/bin/clickhouse
2. ./build_docker/./base/poco/Net/src/NetException.cpp:0: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000049d4608e in /usr/bin/clickhouse
3. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000049d633fa in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::shutdown() @ 0x0000000049d68359 in /usr/bin/clickhouse
5. ./build_docker/./base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x0000000049d7300e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:969: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000003fb16f0f in /usr/bin/clickhouse
7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb2aa8e in /usr/bin/clickhouse
8. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:11.362600 [ 2118 ] {} <Error> DynamicQueryHandler: Code: 81. DB::Exception: Database non_existing_database does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df81a12 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:12.511888 [ 2118 ] {} <Error> DynamicQueryHandler: Code: 81. DB::Exception: Database non_existing_database does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df81a12 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:12.603865 [ 2117 ] {2db4ff74-5525-49db-be77-c32e9a34766b} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38912) (comment: 03174_merge_join_bug.sql) (in query: SET allow_experimental_analyzer=1, join_algorithm = 'full_sorting_merge';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:13.745821 [ 2860 ] {f509ab0b-6274-4cf9-8906-6b4c462835ee} <Error> executeQuery: Code: 182. DB::Exception: Storage Merge doesn't support PREWHERE for _table. (ILLEGAL_PREWHERE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38940) (comment: 01931_storage_merge_no_columns.sql) (in query: select 1 from merge(currentDatabase(), '^data$') prewhere _table in (NULL);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2231: DB::InterpreterSelectQuery::addPrewhereAliasActions() @ 0x0000000039b4d8f3 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2ec3f in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:15.126663 [ 2117 ] {2db4ff74-5525-49db-be77-c32e9a34766b} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:15.126673 [ 2860 ] {f509ab0b-6274-4cf9-8906-6b4c462835ee} <Error> TCPHandler: Code: 182. DB::Exception: Storage Merge doesn't support PREWHERE for _table. (ILLEGAL_PREWHERE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2231: DB::InterpreterSelectQuery::addPrewhereAliasActions() @ 0x0000000039b4d8f3 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2ec3f in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:15.140499 [ 2751 ] {f9f467b2-4544-49bd-926f-244943eeef8e} <Error> executeQuery: Code: 86. DB::HTTPException: Received error from remote server /?query=select+12. HTTP status code: 404 Not Found, body: Code: 81. DB::Exception: Database non_existing_database does not exist. (UNKNOWN_DATABASE) (version 23.8.16.41.altinitystable (altinity build))
: While executing RawBLOBRowInputFormat: While executing URL. (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38866) (comment: 02244_url_engine_headers_test.sql) (in query: select * from url(url_with_headers, url='http://127.0.0.1:8123?query=select+12', format='RawBLOB');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b144ec9 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b14d84e in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::initialize() @ 0x000000002b14ac22 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::nextImpl() @ 0x000000002b1502d1 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadBuffer.h:72: DB::RawBLOBRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003ea3258f in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageURL.cpp:0: DB::StorageURLSource::generate() @ 0x000000003c4c0b93 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:15.417743 [ 2751 ] {f9f467b2-4544-49bd-926f-244943eeef8e} <Error> TCPHandler: Code: 86. DB::HTTPException: Received error from remote server /?query=select+12. HTTP status code: 404 Not Found, body: Code: 81. DB::Exception: Database non_existing_database does not exist. (UNKNOWN_DATABASE) (version 23.8.16.41.altinitystable (altinity build))
: While executing RawBLOBRowInputFormat: While executing URL. (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b144ec9 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b14d84e in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::initialize() @ 0x000000002b14ac22 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::nextImpl() @ 0x000000002b1502d1 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadBuffer.h:72: DB::RawBLOBRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003ea3258f in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageURL.cpp:0: DB::StorageURLSource::generate() @ 0x000000003c4c0b93 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:17.317729 [ 3154 ] {} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000035e1bd4e in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1904: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x00000000378b8175 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x000000003e0df937 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x000000003e0bf4be in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:18.320051 [ 2939 ] {5dbb2d15-8073-4b32-b861-2f9341d7174f} <Error> executeQuery: Code: 36. DB::Exception: Cannot replace partition '201403' because part '201403_1_7_1' has inconsistent granularity with table. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57166) (comment: 00152_insert_different_granularity.sql) (in query: ALTER TABLE fixed_granularity_table REPLACE PARTITION 201403 FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String const&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String const&>::type>, String&, String const&) @ 0x0000000020b56f35 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da7db31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<DB::PartitionCommand, std::allocator<DB::PartitionCommand>> const&, std::shared_ptr<DB::Context const>) @ 0x000000003cf38e8c in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fa088 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:18.427406 [ 2939 ] {5dbb2d15-8073-4b32-b861-2f9341d7174f} <Error> TCPHandler: Code: 36. DB::Exception: Cannot replace partition '201403' because part '201403_1_7_1' has inconsistent granularity with table. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String const&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String const&>::type>, String&, String const&) @ 0x0000000020b56f35 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da7db31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<DB::PartitionCommand, std::allocator<DB::PartitionCommand>> const&, std::shared_ptr<DB::Context const>) @ 0x000000003cf38e8c in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fa088 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:20.178693 [ 3139 ] {} <Error> DynamicQueryHandler: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df81a12 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:20.371466 [ 3139 ] {} <Error> DynamicQueryHandler: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df81a12 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:20.468472 [ 3139 ] {} <Error> DynamicQueryHandler: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df81a12 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:20.507890 [ 2751 ] {17a754fa-cd97-4db0-843f-a14473fbc853} <Error> executeQuery: Code: 86. DB::HTTPException: Received error from remote server /?query=select+12. HTTP status code: 404 Not Found, body: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE) (version 23.8.16.41.altinitystable (altinity build))
: While executing RawBLOBRowInputFormat: While executing URL. (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38866) (comment: 02244_url_engine_headers_test.sql) (in query: select * from url(url_with_headers, url='http://127.0.0.1:8123?query=select+12', format='RawBLOB', headers('X-ClickHouse-Database'='kek'));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b144ec9 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b14d84e in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::initialize() @ 0x000000002b14ac22 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::nextImpl() @ 0x000000002b1502d1 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadBuffer.h:72: DB::RawBLOBRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003ea3258f in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageURL.cpp:0: DB::StorageURLSource::generate() @ 0x000000003c4c0b93 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:20.520450 [ 2751 ] {17a754fa-cd97-4db0-843f-a14473fbc853} <Error> TCPHandler: Code: 86. DB::HTTPException: Received error from remote server /?query=select+12. HTTP status code: 404 Not Found, body: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE) (version 23.8.16.41.altinitystable (altinity build))
: While executing RawBLOBRowInputFormat: While executing URL. (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b144ec9 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b14d84e in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::initialize() @ 0x000000002b14ac22 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::nextImpl() @ 0x000000002b1502d1 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadBuffer.h:72: DB::RawBLOBRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003ea3258f in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageURL.cpp:0: DB::StorageURLSource::generate() @ 0x000000003c4c0b93 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:23.191436 [ 3139 ] {} <Error> DynamicQueryHandler: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df81a12 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:23.308583 [ 3139 ] {} <Error> DynamicQueryHandler: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df81a12 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:23.392046 [ 3139 ] {} <Error> DynamicQueryHandler: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df81a12 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:23.426460 [ 2751 ] {e2a88384-87ae-4385-b6cf-b28369185b6b} <Error> executeQuery: Code: 86. DB::HTTPException: Received error from remote server /?query=select+12. HTTP status code: 404 Not Found, body: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE) (version 23.8.16.41.altinitystable (altinity build))
: While executing RawBLOBRowInputFormat: While executing URL. (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38866) (comment: 02244_url_engine_headers_test.sql) (in query: select * from url('http://127.0.0.1:8123?query=select+12', 'RawBLOB', headers('X-ClickHouse-Format'='JSONEachRow', 'X-ClickHouse-Database'='kek'));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b144ec9 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b14d84e in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::initialize() @ 0x000000002b14ac22 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::nextImpl() @ 0x000000002b1502d1 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadBuffer.h:72: DB::RawBLOBRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003ea3258f in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageURL.cpp:0: DB::StorageURLSource::generate() @ 0x000000003c4c0b93 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:23.432452 [ 2751 ] {e2a88384-87ae-4385-b6cf-b28369185b6b} <Error> TCPHandler: Code: 86. DB::HTTPException: Received error from remote server /?query=select+12. HTTP status code: 404 Not Found, body: Code: 81. DB::Exception: Database kek does not exist. (UNKNOWN_DATABASE) (version 23.8.16.41.altinitystable (altinity build))
: While executing RawBLOBRowInputFormat: While executing URL. (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b144ec9 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b14d84e in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::initialize() @ 0x000000002b14ac22 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::SessionFactory>>>::nextImpl() @ 0x000000002b1502d1 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadBuffer.h:72: DB::RawBLOBRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003ea3258f in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageURL.cpp:0: DB::StorageURLSource::generate() @ 0x000000003c4c0b93 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:24.242795 [ 2751 ] {6683369f-d3f6-4d74-b41e-d55b362a3f49} <Error> executeQuery: Code: 36. DB::Exception: Expected string as header value. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38866) (comment: 02244_url_engine_headers_test.sql) (in query: select * from url('http://127.0.0.1:8123?query=select+12', 'RawBLOB', headers('X-ClickHouse-Format'='JSONEachRow', 'X-ClickHouse-Database'=1));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [32]>(int, char const (&) [32]) @ 0x000000001ad46157 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageURL.cpp:1236: DB::StorageURL::collectHeaders(absl::lts_20211102::InlinedVector<std::shared_ptr<DB::IAST>, 7ul, std::allocator<std::shared_ptr<DB::IAST>>>&, std::vector<DB::HTTPHeaderEntry, std::allocator<DB::HTTPHeaderEntry>>&, std::shared_ptr<DB::Context const>) @ 0x000000003c4d7b97 in /usr/bin/clickhouse
4. ./build_docker/./src/TableFunctions/TableFunctionURL.cpp:0: DB::TableFunctionURL::parseArgumentsImpl(absl::lts_20211102::InlinedVector<std::shared_ptr<DB::IAST>, 7ul, std::allocator<std::shared_ptr<DB::IAST>>>&, std::shared_ptr<DB::Context const> const&) @ 0x0000000034a44ca0 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ITableFunctionFileLike::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x0000000034a3d4bc in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TableFunctionURL::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x0000000034a4442b in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:24.269878 [ 2751 ] {6683369f-d3f6-4d74-b41e-d55b362a3f49} <Error> TCPHandler: Code: 36. DB::Exception: Expected string as header value. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [32]>(int, char const (&) [32]) @ 0x000000001ad46157 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageURL.cpp:1236: DB::StorageURL::collectHeaders(absl::lts_20211102::InlinedVector<std::shared_ptr<DB::IAST>, 7ul, std::allocator<std::shared_ptr<DB::IAST>>>&, std::vector<DB::HTTPHeaderEntry, std::allocator<DB::HTTPHeaderEntry>>&, std::shared_ptr<DB::Context const>) @ 0x000000003c4d7b97 in /usr/bin/clickhouse
4. ./build_docker/./src/TableFunctions/TableFunctionURL.cpp:0: DB::TableFunctionURL::parseArgumentsImpl(absl::lts_20211102::InlinedVector<std::shared_ptr<DB::IAST>, 7ul, std::allocator<std::shared_ptr<DB::IAST>>>&, std::shared_ptr<DB::Context const> const&) @ 0x0000000034a44ca0 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ITableFunctionFileLike::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x0000000034a3d4bc in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TableFunctionURL::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x0000000034a4442b in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:26.011310 [ 3232 ] {cea98f7e-4329-4a3f-9af9-c3926344f076} <Error> executeQuery: Code: 80. DB::Exception: Cannot CREATE a table AS test_z12azz2n.mv_from_base_to_target, it is a Materialized View without storage. Use "AS `test_z12azz2n.target_table`" instead. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57236) (comment: 03161_create_table_as_mv.sql) (in query: CREATE TABLE other_table_2 AS mv_from_base_to_target;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, DB::QualifiedTableName>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<DB::QualifiedTableName>::type>, String const&, DB::QualifiedTableName&&) @ 0x000000003940f415 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:982: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x00000000393c2342 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:673: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b2cf8 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:26.055294 [ 3232 ] {cea98f7e-4329-4a3f-9af9-c3926344f076} <Error> TCPHandler: Code: 80. DB::Exception: Cannot CREATE a table AS test_z12azz2n.mv_from_base_to_target, it is a Materialized View without storage. Use "AS `test_z12azz2n.target_table`" instead. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, DB::QualifiedTableName>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<DB::QualifiedTableName>::type>, String const&, DB::QualifiedTableName&&) @ 0x000000003940f415 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:982: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x00000000393c2342 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:673: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b2cf8 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:28.424430 [ 3207 ] {3ed612e8-6a06-4196-b1ee-9efd453d2d2a} <Error> executeQuery: Code: 8. DB::Exception: Cannot find column `count(equals(7, _CAST(NULL, 'Nullable(UInt64)')))` in source stream, there are only columns: [count(equals(7, _subquery1))]. (THERE_IS_NO_COLUMN) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57262) (comment: 01651_bugs_from_15889.sql) (in query: SELECT count(7 = (SELECT number FROM numbers(0) ORDER BY number ASC NULLS FIRST LIMIT 7)) FROM xp_d PREWHERE toYYYYMM(A) GLOBAL IN (SELECT NULL = (SELECT number FROM numbers(1) ORDER BY number DESC NULLS LAST LIMIT 1), toYYYYMM(min(A)) FROM xp_d) WHERE B > NULL;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000bfd4275 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ActionsDAG.cpp:1261: DB::ActionsDAG::makeConvertingActions(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, DB::ActionsDAG::MatchColumnsMode, bool, bool, std::unordered_map<String, String, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, String>>>*) @ 0x0000000037516c8e in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:876: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4efaf in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:28.435810 [ 3207 ] {3ed612e8-6a06-4196-b1ee-9efd453d2d2a} <Error> TCPHandler: Code: 8. DB::Exception: Cannot find column `count(equals(7, _CAST(NULL, 'Nullable(UInt64)')))` in source stream, there are only columns: [count(equals(7, _subquery1))]. (THERE_IS_NO_COLUMN), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000bfd4275 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ActionsDAG.cpp:1261: DB::ActionsDAG::makeConvertingActions(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, DB::ActionsDAG::MatchColumnsMode, bool, bool, std::unordered_map<String, String, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, String>>>*) @ 0x0000000037516c8e in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:876: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4efaf in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:29.875584 [ 2860 ] {0d8d043f-fe98-47ee-bcbf-656bb8b258c3} <Error> executeQuery: Code: 473. DB::Exception: StorageJoin: cannot insert data because current query tries to read from this storage. (DEADLOCK_AVOIDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41014) (comment: 02695_storage_join_insert_select_deadlock.sql) (in query: INSERT INTO test_table_join SELECT * from test_table_join;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [86]>(int, char const (&) [86]) @ 0x00000000142360f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageJoin.cpp:261: DB::StorageJoin::insertBlock(DB::Block const&, std::shared_ptr<DB::Context const>) @ 0x000000003bcda782 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::consume(DB::Chunk) @ 0x000000003c3c1adf in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:29.892464 [ 3138 ] {718b4c3d-857f-49c0-9a2a-17f53994b46d} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41044) (comment: 03142_untuple_crash.sql) (in query: SET allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:29.904723 [ 3138 ] {718b4c3d-857f-49c0-9a2a-17f53994b46d} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:29.963632 [ 2860 ] {0d8d043f-fe98-47ee-bcbf-656bb8b258c3} <Error> TCPHandler: Code: 473. DB::Exception: StorageJoin: cannot insert data because current query tries to read from this storage. (DEADLOCK_AVOIDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [86]>(int, char const (&) [86]) @ 0x00000000142360f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageJoin.cpp:261: DB::StorageJoin::insertBlock(DB::Block const&, std::shared_ptr<DB::Context const>) @ 0x000000003bcda782 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::consume(DB::Chunk) @ 0x000000003c3c1adf in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:31.933499 [ 2860 ] {3b0e9c3a-8c80-40b8-82da-cdc7b324fcc1} <Error> executeQuery: Code: 473. DB::Exception: StorageJoin: cannot insert data because current query tries to read from this storage. (DEADLOCK_AVOIDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41014) (comment: 02695_storage_join_insert_select_deadlock.sql) (in query: INSERT INTO test_table_join SELECT * FROM (SELECT 1 as id) AS t1 ANY LEFT JOIN test_table_join USING (id);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [86]>(int, char const (&) [86]) @ 0x00000000142360f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageJoin.cpp:261: DB::StorageJoin::insertBlock(DB::Block const&, std::shared_ptr<DB::Context const>) @ 0x000000003bcda782 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::consume(DB::Chunk) @ 0x000000003c3c1adf in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:31.959850 [ 2860 ] {3b0e9c3a-8c80-40b8-82da-cdc7b324fcc1} <Error> TCPHandler: Code: 473. DB::Exception: StorageJoin: cannot insert data because current query tries to read from this storage. (DEADLOCK_AVOIDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [86]>(int, char const (&) [86]) @ 0x00000000142360f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageJoin.cpp:261: DB::StorageJoin::insertBlock(DB::Block const&, std::shared_ptr<DB::Context const>) @ 0x000000003bcda782 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::consume(DB::Chunk) @ 0x000000003c3c1adf in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:32.899823 [ 2117 ] {2ba67349-e956-4b7b-b3c0-68153733253c} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::1]:9010 -> [::1]:54560). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:54560) (in query: SELECT 'Hello, world'), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:33.007664 [ 2117 ] {2ba67349-e956-4b7b-b3c0-68153733253c} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::1]:9010 -> [::1]:54560). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:33.057205 [ 2117 ] {2ba67349-e956-4b7b-b3c0-68153733253c} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:25:34.058768 [ 2860 ] {02a80b93-26d2-4bab-b318-2e839f5558c1} <Error> executeQuery: Code: 473. DB::Exception: StorageJoin: cannot insert data because current query tries to read from this storage. (DEADLOCK_AVOIDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41014) (comment: 02695_storage_join_insert_select_deadlock.sql) (in query: INSERT INTO test_table_join SELECT id, toString(id) FROM (SELECT 1 as id) AS t1 ANY LEFT JOIN (SELECT id FROM test_table_join) AS t2 USING (id);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [86]>(int, char const (&) [86]) @ 0x00000000142360f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageJoin.cpp:261: DB::StorageJoin::insertBlock(DB::Block const&, std::shared_ptr<DB::Context const>) @ 0x000000003bcda782 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::consume(DB::Chunk) @ 0x000000003c3c1adf in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
13. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:34.113796 [ 2860 ] {02a80b93-26d2-4bab-b318-2e839f5558c1} <Error> TCPHandler: Code: 473. DB::Exception: StorageJoin: cannot insert data because current query tries to read from this storage. (DEADLOCK_AVOIDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [86]>(int, char const (&) [86]) @ 0x00000000142360f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageJoin.cpp:261: DB::StorageJoin::insertBlock(DB::Block const&, std::shared_ptr<DB::Context const>) @ 0x000000003bcda782 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::consume(DB::Chunk) @ 0x000000003c3c1adf in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
13. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:38.701822 [ 3154 ] {8c3d900f-0f83-47b1-9648-e050f3ff0270} <Error> executeQuery: Code: 574. DB::Exception: Too many bytes pending for async INSERT: 2.33 KiB (bytes_to_delay_insert=1.00 B). (DISTRIBUTED_TOO_MANY_PENDING_BYTES) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:45064) (comment: 01675_distributed_bytes_to_delay_insert.sh) (in query: insert into dist_01675 select * from numbers(1) settings prefer_localhost_replica=0), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:1577: DB::StorageDistributed::delayInsertOrThrowIfNeeded() const @ 0x000000003bbad6d6 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/Distributed/DistributedSink.cpp:145: DB::DistributedSink::consume(DB::Chunk) @ 0x000000003cb12b70 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:0: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f767d in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9b0e75 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
17. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:38.951704 [ 3154 ] {8c3d900f-0f83-47b1-9648-e050f3ff0270} <Error> DynamicQueryHandler: Code: 574. DB::Exception: Too many bytes pending for async INSERT: 2.33 KiB (bytes_to_delay_insert=1.00 B). (DISTRIBUTED_TOO_MANY_PENDING_BYTES), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:1577: DB::StorageDistributed::delayInsertOrThrowIfNeeded() const @ 0x000000003bbad6d6 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/Distributed/DistributedSink.cpp:145: DB::DistributedSink::consume(DB::Chunk) @ 0x000000003cb12b70 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:0: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f767d in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9b0e75 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
17. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:25:44.432500 [ 3981 ] {} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000035e1bd4e in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1904: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x00000000378b8175 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x000000003e0df937 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x000000003e0bf4be in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:51.252145 [ 2759 ] {a29d78de-51b6-4646-a118-7fca8b6bb1c9} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 58.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column URL): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38924) (comment: 00139_like.sql) (in query: SELECT count() FROM test.hits WHERE URL LIKE '%_/avtomobili_s_probegom/_%__%__%__%';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
18. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/deque:1902: DB::MergeTreeReaderWide::prefetchBeginOfRange(Priority) @ 0x000000003d4aca14 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreePrefetchedReadPool.cpp:0: std::__packaged_task_func<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'()>, std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>> ()>::operator()() @ 0x000000003f25bd51 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>> ()>::operator()() @ 0x000000003f26a692 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003f25c3ae in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:53.676716 [ 2759 ] {a29d78de-51b6-4646-a118-7fca8b6bb1c9} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 58.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column URL): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
18. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/deque:1902: DB::MergeTreeReaderWide::prefetchBeginOfRange(Priority) @ 0x000000003d4aca14 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreePrefetchedReadPool.cpp:0: std::__packaged_task_func<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'()>, std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>> ()>::operator()() @ 0x000000003f25bd51 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>> ()>::operator()() @ 0x000000003f26a692 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003f25c3ae in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:25:53.677100 [ 3979 ] {38b4dba9-4718-4a70-b649-25b699535eae} <Error> executeQuery: Code: 28. DB::Exception: Too high precision requested for Float, must not be more than 60, got 61: While processing toDecimalString(CAST('32.32', 'Float32'), 61). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: -- Max number of decimal fractional digits is defined as 77 for Int/UInt/Decimal and 60 for Float.
 -- These values shall work OK.
 SELECT toDecimalString('32.32'::Float32, 61);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<signed char>(int, FormatStringHelperImpl<std::type_identity<signed char>::type>, signed char&&) @ 0x000000000a7b5f8f in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::format<float>(float, DB::WriteBuffer&, char8_t) @ 0x000000000a7b59b6 in /usr/bin/clickhouse
4. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<float, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<float, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) const @ 0x000000000a7b5145 in /usr/bin/clickhouse
5. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<float>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a79f8af in /usr/bin/clickhouse
6. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a7928d0 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:25:53.796994 [ 3979 ] {38b4dba9-4718-4a70-b649-25b699535eae} <Error> TCPHandler: Code: 28. DB::Exception: Too high precision requested for Float, must not be more than 60, got 61: While processing toDecimalString(CAST('32.32', 'Float32'), 61). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<signed char>(int, FormatStringHelperImpl<std::type_identity<signed char>::type>, signed char&&) @ 0x000000000a7b5f8f in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::format<float>(float, DB::WriteBuffer&, char8_t) @ 0x000000000a7b59b6 in /usr/bin/clickhouse
4. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<float, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<float, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) const @ 0x000000000a7b5145 in /usr/bin/clickhouse
5. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<float>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a79f8af in /usr/bin/clickhouse
6. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a7928d0 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:25:57.118254 [ 3979 ] {16b5f8c1-db2a-4428-839d-bfc07ac2a0ce} <Error> executeQuery: Code: 28. DB::Exception: Too high precision requested for Float, must not be more than 60, got 61: While processing toDecimalString(CAST('64.64', 'Float64'), 61). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: SELECT toDecimalString('64.64'::Float64, 61);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<signed char>(int, FormatStringHelperImpl<std::type_identity<signed char>::type>, signed char&&) @ 0x000000000a7b5f8f in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::format<double>(double, DB::WriteBuffer&, char8_t) @ 0x000000000a7b7427 in /usr/bin/clickhouse
4. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<double, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<double, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) const @ 0x000000000a7b6ba6 in /usr/bin/clickhouse
5. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<double>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a7a078f in /usr/bin/clickhouse
6. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a79295e in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:25:58.927303 [ 3979 ] {16b5f8c1-db2a-4428-839d-bfc07ac2a0ce} <Error> TCPHandler: Code: 28. DB::Exception: Too high precision requested for Float, must not be more than 60, got 61: While processing toDecimalString(CAST('64.64', 'Float64'), 61). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<signed char>(int, FormatStringHelperImpl<std::type_identity<signed char>::type>, signed char&&) @ 0x000000000a7b5f8f in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::format<double>(double, DB::WriteBuffer&, char8_t) @ 0x000000000a7b7427 in /usr/bin/clickhouse
4. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<double, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<double, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) const @ 0x000000000a7b6ba6 in /usr/bin/clickhouse
5. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<double>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a7a078f in /usr/bin/clickhouse
6. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a79295e in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:25:58.931859 [ 3982 ] {8d08e5d0-79c7-4865-bd00-7010aac3c3c7} <Error> executeQuery: Code: 43. DB::Exception: Argument 'max_width' must not be NaN: While processing bar((greatCircleAngle(65537, 2, 1, 1) - 1) * 65535, 1048576, 1048577, nan). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53684) (comment: 01621_bar_nan_arguments.sql) (in query: SELECT bar((greatCircleAngle(65537, 2, 1, 1) - 1) * 65535, 1048576, 1048577, nan);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [37]>(int, char const (&) [37]) @ 0x000000000ca077f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ca06589 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:25:58.939563 [ 3982 ] {8d08e5d0-79c7-4865-bd00-7010aac3c3c7} <Error> TCPHandler: Code: 43. DB::Exception: Argument 'max_width' must not be NaN: While processing bar((greatCircleAngle(65537, 2, 1, 1) - 1) * 65535, 1048576, 1048577, nan). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [37]>(int, char const (&) [37]) @ 0x000000000ca077f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ca06589 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:26:00.978078 [ 3982 ] {b106b468-e694-4926-8c69-098ee03e4500} <Error> executeQuery: Code: 43. DB::Exception: Argument 'max_width' must not be NaN: While processing bar(1, 1, 1, nan). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53684) (comment: 01621_bar_nan_arguments.sql) (in query: select bar(1,1,1,nan);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [37]>(int, char const (&) [37]) @ 0x000000000ca077f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ca06589 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:26:01.008292 [ 3982 ] {b106b468-e694-4926-8c69-098ee03e4500} <Error> TCPHandler: Code: 43. DB::Exception: Argument 'max_width' must not be NaN: While processing bar(1, 1, 1, nan). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [37]>(int, char const (&) [37]) @ 0x000000000ca077f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ca06589 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:26:01.019020 [ 3979 ] {fae2f940-e616-4298-8237-8c318debffe6} <Error> executeQuery: Code: 28. DB::Exception: Too many fractional digits requested, shall not be more than 77: While processing toDecimalString(CAST('88', 'UInt8'), 78). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: SELECT toDecimalString('88'::UInt8, 78);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type>, unsigned long const&) @ 0x000000000a7a5478 in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) const @ 0x000000000a7a4389 in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<char8_t>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a794630 in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a792843 in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:26:01.035284 [ 3979 ] {fae2f940-e616-4298-8237-8c318debffe6} <Error> TCPHandler: Code: 28. DB::Exception: Too many fractional digits requested, shall not be more than 77: While processing toDecimalString(CAST('88', 'UInt8'), 78). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type>, unsigned long const&) @ 0x000000000a7a5478 in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) const @ 0x000000000a7a4389 in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<char8_t>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a794630 in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a792843 in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:26:02.807368 [ 3979 ] {509cf5ee-c1fe-4482-bdb4-a98514612b0a} <Error> executeQuery: Code: 28. DB::Exception: Too many fractional digits requested, shall not be more than 77: While processing toDecimalString(CAST('646464', 'Int256'), 78). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: SELECT toDecimalString('646464'::Int256, 78);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type>, unsigned long const&) @ 0x000000000a7a5478 in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<wide::integer<256ul, int>, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<wide::integer<256ul, int>, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) const @ 0x000000000a7b3d0f in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<wide::integer<256ul, int>>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a79e9cf in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a792872 in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:26:02.824350 [ 3979 ] {509cf5ee-c1fe-4482-bdb4-a98514612b0a} <Error> TCPHandler: Code: 28. DB::Exception: Too many fractional digits requested, shall not be more than 77: While processing toDecimalString(CAST('646464', 'Int256'), 78). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type>, unsigned long const&) @ 0x000000000a7a5478 in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<wide::integer<256ul, int>, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<wide::integer<256ul, int>, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) const @ 0x000000000a7b3d0f in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<wide::integer<256ul, int>>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a79e9cf in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a792872 in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:26:05.132641 [ 3979 ] {15a943f0-5042-45f0-9a1b-70048f88e62a} <Error> executeQuery: Code: 28. DB::Exception: Too many fractional digits requested for Decimal, must not be more than 77: While processing toDecimalString(CAST('-128.789323123321329854641231237893231233213298546', 'Decimal256(45)'), 78). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: SELECT toDecimalString('-128.789323123321329854641231237893231233213298546'::Decimal256(45), 78);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type>, unsigned long const&) @ 0x000000000a7a5478 in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<DB::Decimal<wide::integer<256ul, int>>, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<DB::Decimal<wide::integer<256ul, int>>, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, char8_t) const @ 0x000000000a7bc15a in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<DB::Decimal<wide::integer<256ul, int>>>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a7a37bc in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a79298f in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:26:05.151073 [ 3979 ] {15a943f0-5042-45f0-9a1b-70048f88e62a} <Error> TCPHandler: Code: 28. DB::Exception: Too many fractional digits requested for Decimal, must not be more than 77: While processing toDecimalString(CAST('-128.789323123321329854641231237893231233213298546', 'Decimal256(45)'), 78). (CANNOT_PRINT_FLOAT_OR_DOUBLE_NUMBER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type>, unsigned long const&) @ 0x000000000a7a5478 in /usr/bin/clickhouse
3. void DB::FunctionToDecimalString::vectorVector<DB::PODArray<DB::Decimal<wide::integer<256ul, int>>, 4096ul, Allocator<false, false>, 63ul, 64ul>>(DB::PODArray<DB::Decimal<wide::integer<256ul, int>>, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, char8_t) const @ 0x000000000a7bc15a in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionToDecimalString::executeType<DB::Decimal<wide::integer<256ul, int>>>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a7a37bc in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a79298f in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:26:07.206073 [ 3979 ] {4a4b81b8-0c17-44b3-8dfb-7d61f8ffaa18} <Error> executeQuery: Code: 44. DB::Exception: Illegal type of argument #2 'precision' of function toDecimalString, expected const Integer, got UInt8: While processing toDecimalString(CAST('256.256', 'Decimal256(45)'), dummy). (ILLEGAL_COLUMN) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: -- wrong types: #52407 and similar
 SELECT toDecimalString('256.256'::Decimal256(45), *);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned long, String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x00000000352f5442 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, unsigned long, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352eeca5 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352ec407 in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a793541 in /usr/bin/clickhouse
6. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:26:08.530919 [ 4381 ] {747cd5be-37fd-4854-9759-58eb52b7e80d} <Error> DynamicQueryHandler: Code: 246. DB::Exception: Too large uncompressed size: 4294967295. (CORRUPTED_DATA), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned int&>::type>, unsigned int&) @ 0x0000000035402fb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Compression/CompressionCodecMultiple.cpp:0: DB::CompressionCodecMultiple::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x00000000368e4904 in /usr/bin/clickhouse
4. ./build_docker/./src/Compression/ICompressionCodec.cpp:112: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x00000000369cfaaa in /usr/bin/clickhouse
5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:308: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x00000000368ab1a3 in /usr/bin/clickhouse
6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x00000000368a5253 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper<std::nullptr_t>::nextImpl() @ 0x0000000036204997 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x00000000377fda03 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadBuffer.h:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9ac740 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:08.618823 [ 3979 ] {4a4b81b8-0c17-44b3-8dfb-7d61f8ffaa18} <Error> TCPHandler: Code: 44. DB::Exception: Illegal type of argument #2 'precision' of function toDecimalString, expected const Integer, got UInt8: While processing toDecimalString(CAST('256.256', 'Decimal256(45)'), dummy). (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned long, String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x00000000352f5442 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, unsigned long, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352eeca5 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352ec407 in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a793541 in /usr/bin/clickhouse
6. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:26:08.771163 [ 3979 ] {f6a91753-3557-424a-9d28-1df5eed59ee7} <Error> executeQuery: Code: 43. DB::Exception: Illegal type of argument #2 'precision' of function toDecimalString, expected const Integer, got String: While processing toDecimalString(CAST('128.128', 'Decimal128(30)'), 'str'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: SELECT toDecimalString('128.128'::Decimal128(30), 'str');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned long, String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x00000000352f5442 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, unsigned long, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352eeca5 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352ec407 in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a793541 in /usr/bin/clickhouse
6. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:26:08.789278 [ 3979 ] {f6a91753-3557-424a-9d28-1df5eed59ee7} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type of argument #2 'precision' of function toDecimalString, expected const Integer, got String: While processing toDecimalString(CAST('128.128', 'Decimal128(30)'), 'str'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned long, String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x00000000352f5442 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, unsigned long, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352eeca5 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352ec407 in /usr/bin/clickhouse
5. DB::FunctionToDecimalString::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a793541 in /usr/bin/clickhouse
6. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:26:13.065683 [ 3979 ] {9eaf68e7-ecd0-4686-b1a8-7314e93586cd} <Error> executeQuery: Code: 42. DB::Exception: Number of arguments for function toDecimalString doesn't match: passed 1, should be 2: While processing toDecimalString(CAST('64.64', 'Decimal64(10)')). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: SELECT toDecimalString('64.64'::Decimal64(10));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002d09e090 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x00000000352c9c0d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352caf9f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:26:13.791021 [ 2751 ] {f69ab955-208a-4c61-b077-603d93a08a16} <Error> DynamicQueryHandler: Code: 246. DB::Exception: Wrong data for compression codec NONE: source_size (278) != uncompressed_size (33686018). (CORRUPTED_DATA), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned int&, unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned int&>::type, std::type_identity<unsigned int&>::type>, unsigned int&, unsigned int&) @ 0x00000000349c9a0d in /usr/bin/clickhouse
3. ./build_docker/./src/Compression/CompressionCodecNone.cpp:38: DB::CompressionCodecNone::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x00000000368d949b in /usr/bin/clickhouse
4. ./build_docker/./src/Compression/ICompressionCodec.cpp:112: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x00000000369cfaaa in /usr/bin/clickhouse
5. ./build_docker/./src/Common/PODArray.h:174: DB::CompressionCodecMultiple::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x00000000368e39d5 in /usr/bin/clickhouse
6. ./build_docker/./src/Compression/ICompressionCodec.cpp:112: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x00000000369cfaaa in /usr/bin/clickhouse
7. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:308: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x00000000368ab1a3 in /usr/bin/clickhouse
8. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x00000000368a5253 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper<std::nullptr_t>::nextImpl() @ 0x0000000036204997 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x00000000377fda03 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/ReadBuffer.h:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9ac740 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
13. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
14. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:14.141867 [ 2950 ] {0063b87f-ad11-4351-9f66-19300b17a60b} <Error> executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 582.28 MiB: While executing MergeTreeThread. (TOO_MANY_BYTES) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38958) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:14.920335 [ 4002 ] {a28d474a-3506-429c-b832-c4562e11bec7} <Error> executeQuery: Code: 48. DB::Exception: MergeJoinAlgorithm is not implemented for strictness Asof. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55438) (comment: 00927_asof_join_correct_bt.sql) (in query: SELECT A.k, A.t, A.a, B.b, B.t, B.k FROM A ASOF LEFT JOIN B USING(k,t) ORDER BY (A.k, A.t);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<DB::JoinStrictness&>(int, FormatStringHelperImpl<std::type_identity<DB::JoinStrictness&>::type>, DB::JoinStrictness&) @ 0x000000003ebf236d in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/Transforms/MergeJoinTransform.cpp:294: DB::MergeJoinAlgorithm::MergeJoinAlgorithm(std::shared_ptr<DB::IJoin>, std::vector<DB::Block, std::allocator<DB::Block>> const&, unsigned long) @ 0x000000003ebdd080 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Merges/IMergingTransform.h:159: DB::MergeJoinTransform::MergeJoinTransform(std::shared_ptr<DB::IJoin>, std::vector<DB::Block, std::allocator<DB::Block>> const&, DB::Block const&, unsigned long, unsigned long) @ 0x000000003ebef5ef in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeJoinTransform> std::allocate_shared[abi:v15000]<DB::MergeJoinTransform, std::allocator<DB::MergeJoinTransform>, std::shared_ptr<DB::IJoin>&, std::vector<DB::Block, std::allocator<DB::Block>>&, DB::Block const&, unsigned long&, void>(std::allocator<DB::MergeJoinTransform> const&, std::shared_ptr<DB::IJoin>&, std::vector<DB::Block, std::allocator<DB::Block>>&, DB::Block const&, unsigned long&) @ 0x0000000036a61779 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::QueryPipelineBuilder::joinPipelinesYShaped(std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::shared_ptr<DB::IJoin>, DB::Block const&, unsigned long, std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>*) @ 0x0000000036a45aba in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:41: DB::JoinStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f13c65c in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:15.588328 [ 3979 ] {9eaf68e7-ecd0-4686-b1a8-7314e93586cd} <Error> TCPHandler: Code: 42. DB::Exception: Number of arguments for function toDecimalString doesn't match: passed 1, should be 2: While processing toDecimalString(CAST('64.64', 'Decimal64(10)')). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002d09e090 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x00000000352c9c0d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352caf9f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:26:15.588376 [ 3993 ] {c38c4b30-b4ac-4faa-804b-3de93cff1e01} <Error> executeQuery: Code: 10. DB::Exception: Not found column CounterID in block. There are only columns: k, quantileBFloat16(0.5)(ResolutionWidth): While executing Remote. (NOT_FOUND_COLUMN_IN_BLOCK) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55074) (comment: 00164_quantileBfloat16.sql) (in query: SELECT CounterID AS k, quantileBFloat16(0.5)(ResolutionWidth) FROM remote('127.0.0.{1,2}', test.hits) GROUP BY k ORDER BY count() DESC, CounterID LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000bfd4275 in /usr/bin/clickhouse
3. ./build_docker/./src/Core/Block.cpp:315: DB::Block::getByName(String const&, bool) const @ 0x000000003629690f in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/RemoteQueryExecutor.cpp:215: DB::adaptBlockStructure(DB::Block const&, DB::Block const&) @ 0x0000000036a90e26 in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/RemoteQueryExecutor.h:112: DB::RemoteQueryExecutor::processPacket(DB::Packet) @ 0x0000000036a8971c in /usr/bin/clickhouse
6. ./build_docker/./src/QueryPipeline/RemoteQueryExecutor.cpp:390: DB::RemoteQueryExecutor::readAsync() @ 0x0000000036a8dfc7 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Sources/RemoteSource.cpp:123: DB::RemoteSource::tryGenerate() @ 0x000000003ee3c4b2 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
13. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:17.135305 [ 2950 ] {0063b87f-ad11-4351-9f66-19300b17a60b} <Error> TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 582.28 MiB: While executing MergeTreeThread. (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:17.135529 [ 3989 ] {e66d719a-c1cb-44e2-8e0e-8c1583edafac} <Error> executeQuery: Code: 36. DB::Exception: Incorrect argument 2 type of function arrayEnumerateUniqRanked. Expected an Array or Const(UInt64), got UInt8: While processing arrayEnumerateUniqRanked(arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]]), materialize(1 AS x) OR toLowCardinality(-9223372036854775808)). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38496) (comment: 03003_arrayEnumerate_crash.sql) (in query: SELECT arrayEnumerateUniqRanked(arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]]), materialize(1 AS x) OR toLowCardinality(-9223372036854775808));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, char const*&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<char const*&>::type, std::type_identity<String>::type>, unsigned long&&, char const*&, String&&) @ 0x000000001f69fa7a in /usr/bin/clickhouse
3. DB::getArraysDepths(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, char const*) @ 0x000000001f69e57e in /usr/bin/clickhouse
4. DB::FunctionArrayEnumerateRankedExtended<DB::FunctionArrayEnumerateUniqRanked>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001f6d97d1 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:26:17.705104 [ 3154 ] {a5924b9c-3be5-4a80-8f72-77758a3b3e31} <Error> executeQuery: Code: 48. DB::Exception: ReplicatedMergeTree (table test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf)) does not support transactions. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38486) (comment: 00509_extended_storage_definition_syntax_zookeeper.sql) (in query: INSERT INTO replicated_with_sampling VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000039617105 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x0000000039ab2f4c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:17.705217 [ 4002 ] {a28d474a-3506-429c-b832-c4562e11bec7} <Error> TCPHandler: Code: 48. DB::Exception: MergeJoinAlgorithm is not implemented for strictness Asof. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<DB::JoinStrictness&>(int, FormatStringHelperImpl<std::type_identity<DB::JoinStrictness&>::type>, DB::JoinStrictness&) @ 0x000000003ebf236d in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/Transforms/MergeJoinTransform.cpp:294: DB::MergeJoinAlgorithm::MergeJoinAlgorithm(std::shared_ptr<DB::IJoin>, std::vector<DB::Block, std::allocator<DB::Block>> const&, unsigned long) @ 0x000000003ebdd080 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Merges/IMergingTransform.h:159: DB::MergeJoinTransform::MergeJoinTransform(std::shared_ptr<DB::IJoin>, std::vector<DB::Block, std::allocator<DB::Block>> const&, DB::Block const&, unsigned long, unsigned long) @ 0x000000003ebef5ef in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeJoinTransform> std::allocate_shared[abi:v15000]<DB::MergeJoinTransform, std::allocator<DB::MergeJoinTransform>, std::shared_ptr<DB::IJoin>&, std::vector<DB::Block, std::allocator<DB::Block>>&, DB::Block const&, unsigned long&, void>(std::allocator<DB::MergeJoinTransform> const&, std::shared_ptr<DB::IJoin>&, std::vector<DB::Block, std::allocator<DB::Block>>&, DB::Block const&, unsigned long&) @ 0x0000000036a61779 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::QueryPipelineBuilder::joinPipelinesYShaped(std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::shared_ptr<DB::IJoin>, DB::Block const&, unsigned long, std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>*) @ 0x0000000036a45aba in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:41: DB::JoinStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f13c65c in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:18.534805 [ 3980 ] {9e358092-f147-4b3d-848d-b3623d033c42} <Error> executeQuery: Code: 190. DB::Exception: Elements 'NestedColumn.ID' and 'NestedColumn.Count' of Nested data structure 'NestedColumn' (Array columns) have different array sizes. (SIZES_OF_ARRAYS_DONT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34688) (comment: 00698_validate_array_sizes_for_nested_kshvakov.sql) (in query: INSERT INTO Issue_2231_Invalid_Nested_Columns_Size VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, String const&, String&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String const&>::type, std::type_identity<String&>::type>, String const&, String const&, String&) @ 0x0000000036df6e5e in /usr/bin/clickhouse
3. ./build_docker/./src/DataTypes/NestedUtils.cpp:257: DB::Nested::validateArraySizes(DB::Block const&) @ 0x0000000036deff8f in /usr/bin/clickhouse
4. ./build_docker/./src/Core/Block.h:25: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee66414 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:867: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c24be in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:19.285278 [ 3993 ] {c38c4b30-b4ac-4faa-804b-3de93cff1e01} <Error> TCPHandler: Code: 10. DB::Exception: Not found column CounterID in block. There are only columns: k, quantileBFloat16(0.5)(ResolutionWidth): While executing Remote. (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000bfd4275 in /usr/bin/clickhouse
3. ./build_docker/./src/Core/Block.cpp:315: DB::Block::getByName(String const&, bool) const @ 0x000000003629690f in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/RemoteQueryExecutor.cpp:215: DB::adaptBlockStructure(DB::Block const&, DB::Block const&) @ 0x0000000036a90e26 in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/RemoteQueryExecutor.h:112: DB::RemoteQueryExecutor::processPacket(DB::Packet) @ 0x0000000036a8971c in /usr/bin/clickhouse
6. ./build_docker/./src/QueryPipeline/RemoteQueryExecutor.cpp:390: DB::RemoteQueryExecutor::readAsync() @ 0x0000000036a8dfc7 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Sources/RemoteSource.cpp:123: DB::RemoteSource::tryGenerate() @ 0x000000003ee3c4b2 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
13. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:19.285299 [ 3239 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:41290). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:20.463534 [ 3989 ] {e66d719a-c1cb-44e2-8e0e-8c1583edafac} <Error> TCPHandler: Code: 36. DB::Exception: Incorrect argument 2 type of function arrayEnumerateUniqRanked. Expected an Array or Const(UInt64), got UInt8: While processing arrayEnumerateUniqRanked(arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]]), materialize(1 AS x) OR toLowCardinality(-9223372036854775808)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, char const*&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<char const*&>::type, std::type_identity<String>::type>, unsigned long&&, char const*&, String&&) @ 0x000000001f69fa7a in /usr/bin/clickhouse
3. DB::getArraysDepths(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, char const*) @ 0x000000001f69e57e in /usr/bin/clickhouse
4. DB::FunctionArrayEnumerateRankedExtended<DB::FunctionArrayEnumerateUniqRanked>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001f6d97d1 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:26:20.463537 [ 3154 ] {a5924b9c-3be5-4a80-8f72-77758a3b3e31} <Error> TCPHandler: Code: 48. DB::Exception: ReplicatedMergeTree (table test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf)) does not support transactions. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000039617105 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x0000000039ab2f4c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:20.463614 [ 3207 ] {41bd1322-4a8c-4377-b909-89f5aedf19ac} <Error> executeQuery: Code: 125. DB::Exception: Scalar subquery returned empty result of type Tuple(Array(Nullable(Float64)), String) which cannot be Nullable: While processing (WITH concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol SELECT [NULL, NULL, NULL, NULL, 0.00009999999747378752, NULL, NULL, NULL, NULL, NULL], query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (query LIKE '%test cpu time query profiler%') AND (query NOT LIKE '%system%') ORDER BY event_time DESC LIMIT 1) AS _subquery34: While processing query_id = ((WITH concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol SELECT [NULL, NULL, NULL, NULL, 0.00009999999747378752, NULL, NULL, NULL, NULL, NULL], query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (query LIKE '%test cpu time query profiler%') AND (query NOT LIKE '%system%') ORDER BY event_time DESC LIMIT 1) AS _subquery34): While processing (query_id = ((WITH concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol SELECT [NULL, NULL, NULL, NULL, 0.00009999999747378752, NULL, NULL, NULL, NULL, NULL], query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (query LIKE '%test cpu time query profiler%') AND (query NOT LIKE '%system%') ORDER BY event_time DESC LIMIT 1) AS _subquery34)) AND ((concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol) LIKE '%Source%'). (INCORRECT_RESULT_OF_SCALAR_SUBQUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57262) (comment: 01651_bugs_from_15889.sql) (in query: WITH concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol SELECT count() > 7 FROM trace_log AS t WHERE (query_id = ( SELECT [NULL, NULL, NULL, NULL, 0.00009999999747378752, NULL, NULL, NULL, NULL, NULL], query_id FROM system.query_log WHERE current_database = currentDatabase() AND (query LIKE '%test cpu time query profiler%') AND (query NOT LIKE '%system%') ORDER BY event_time DESC LIMIT 1 )) AND (symbol LIKE '%Source%');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:204: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f721e0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f687be in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.h:35: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context const>, unsigned long, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, bool, bool) @ 0x000000003a70965e in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a6f91d4 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:26:20.467322 [ 3980 ] {9e358092-f147-4b3d-848d-b3623d033c42} <Error> TCPHandler: Code: 190. DB::Exception: Elements 'NestedColumn.ID' and 'NestedColumn.Count' of Nested data structure 'NestedColumn' (Array columns) have different array sizes. (SIZES_OF_ARRAYS_DONT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, String const&, String&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String const&>::type, std::type_identity<String&>::type>, String const&, String const&, String&) @ 0x0000000036df6e5e in /usr/bin/clickhouse
3. ./build_docker/./src/DataTypes/NestedUtils.cpp:257: DB::Nested::validateArraySizes(DB::Block const&) @ 0x0000000036deff8f in /usr/bin/clickhouse
4. ./build_docker/./src/Core/Block.h:25: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee66414 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:867: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c24be in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:20.467584 [ 3979 ] {9e17af18-ae88-49a3-a594-03514c8919fa} <Error> executeQuery: Code: 42. DB::Exception: Number of arguments for function toDecimalString doesn't match: passed 3, should be 2: While processing toDecimalString(CAST('64.64', 'Decimal64(10)'), 3, 3). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49758) (comment: 02676_to_decimal_string.sql) (in query: SELECT toDecimalString('64.64'::Decimal64(10), 3, 3);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002d09e090 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x00000000352c9c0d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352caf9f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:26:20.881228 [ 3101 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:53362). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:20.881301 [ 3987 ] {0725e354-f0ec-4b1a-bd19-fb5928d4e6c1} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:48148). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:48148) (comment: 00991_system_parts_race_condition_long.sh) (in query: INSERT INTO alter_table SELECT rand(1), rand(2), 1 / rand(3), toString(rand(4)), [rand(5), rand(6)], rand(7) % 2 ? NULL : generateUUIDv4(), (rand(8), rand(9)) FROM numbers(100000)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProfileEvents() @ 0x000000003e0d4b01 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8976 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:21.463347 [ 2861 ] {301dbc79-6af1-4f6f-b885-dac76146addf} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:48216). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:48216) (comment: 00991_system_parts_race_condition_long.sh) (in query: INSERT INTO alter_table SELECT rand(1), rand(2), 1 / rand(3), toString(rand(4)), [rand(5), rand(6)], rand(7) % 2 ? NULL : generateUUIDv4(), (rand(8), rand(9)) FROM numbers(100000)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::getQueryCancellationStatus() @ 0x000000003e0cc472 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:533: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::TCPHandler::runImpl()::$_10, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003e0f3a84 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:99: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f736a in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:546: DB::TCPHandler::runImpl() @ 0x000000003e0a8868 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:21.464279 [ 3991 ] {bc57fe1a-af15-4449-9ff0-e9adb4bfe8e2} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:48182). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:48182) (comment: 00991_system_parts_race_condition_long.sh) (in query: INSERT INTO alter_table SELECT rand(1), rand(2), 1 / rand(3), toString(rand(4)), [rand(5), rand(6)], rand(7) % 2 ? NULL : generateUUIDv4(), (rand(8), rand(9)) FROM numbers(100000)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::getQueryCancellationStatus() @ 0x000000003e0cc472 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:533: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::TCPHandler::runImpl()::$_10, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003e0f3a84 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:99: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f736a in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:546: DB::TCPHandler::runImpl() @ 0x000000003e0a8868 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:21.475051 [ 3990 ] {71f53692-5208-497f-83bc-511443d5b50f} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:48172). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:48172) (comment: 00991_system_parts_race_condition_long.sh) (in query: INSERT INTO alter_table SELECT rand(1), rand(2), 1 / rand(3), toString(rand(4)), [rand(5), rand(6)], rand(7) % 2 ? NULL : generateUUIDv4(), (rand(8), rand(9)) FROM numbers(100000)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::getQueryCancellationStatus() @ 0x000000003e0cc472 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:533: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::TCPHandler::runImpl()::$_10, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003e0f3a84 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:99: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f736a in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:546: DB::TCPHandler::runImpl() @ 0x000000003e0a8868 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:21.686235 [ 3979 ] {9e17af18-ae88-49a3-a594-03514c8919fa} <Error> TCPHandler: Code: 42. DB::Exception: Number of arguments for function toDecimalString doesn't match: passed 3, should be 2: While processing toDecimalString(CAST('64.64', 'Decimal64(10)'), 3, 3). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002d09e090 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x00000000352c9c0d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352caf9f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:26:21.686241 [ 3207 ] {41bd1322-4a8c-4377-b909-89f5aedf19ac} <Error> TCPHandler: Code: 125. DB::Exception: Scalar subquery returned empty result of type Tuple(Array(Nullable(Float64)), String) which cannot be Nullable: While processing (WITH concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol SELECT [NULL, NULL, NULL, NULL, 0.00009999999747378752, NULL, NULL, NULL, NULL, NULL], query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (query LIKE '%test cpu time query profiler%') AND (query NOT LIKE '%system%') ORDER BY event_time DESC LIMIT 1) AS _subquery34: While processing query_id = ((WITH concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol SELECT [NULL, NULL, NULL, NULL, 0.00009999999747378752, NULL, NULL, NULL, NULL, NULL], query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (query LIKE '%test cpu time query profiler%') AND (query NOT LIKE '%system%') ORDER BY event_time DESC LIMIT 1) AS _subquery34): While processing (query_id = ((WITH concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol SELECT [NULL, NULL, NULL, NULL, 0.00009999999747378752, NULL, NULL, NULL, NULL, NULL], query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (query LIKE '%test cpu time query profiler%') AND (query NOT LIKE '%system%') ORDER BY event_time DESC LIMIT 1) AS _subquery34)) AND ((concat(addressToLine(arrayJoin(trace) AS addr), '#') AS symbol) LIKE '%Source%'). (INCORRECT_RESULT_OF_SCALAR_SUBQUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:204: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f721e0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f687be in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.h:35: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context const>, unsigned long, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, bool, bool) @ 0x000000003a70965e in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a6f91d4 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:26:21.702721 [ 3151 ] {c7082a54-c3db-42cd-b711-e7a357689fbe} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 13.25 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53614) (comment: 00063_loyalty_joins.sql) (in query: SELECT loyalty, count() FROM ( SELECT loyalty, UserID FROM ( SELECT UserID FROM test.hits ) ANY LEFT JOIN ( SELECT UserID, sum(SearchEngineID = 2) AS yandex, sum(SearchEngineID = 3) AS google, toInt8(if(yandex > google, yandex / (yandex + google), -google / (yandex + google)) * 10) AS loyalty FROM test.hits WHERE (SearchEngineID = 2) OR (SearchEngineID = 3) GROUP BY UserID HAVING (yandex + google) > 10 ) USING UserID ) GROUP BY loyalty ORDER BY loyalty ASC;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:22.054912 [ 3989 ] {a6153d08-1d95-4ce5-9b20-e4935fa7cd4a} <Error> executeQuery: Code: 36. DB::Exception: Incorrect argument 2 type of function arrayEnumerateUniqRanked. Expected an Array or Const(UInt64), got UInt64: While processing arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]], number). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38496) (comment: 03003_arrayEnumerate_crash.sql) (in query: SELECT arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]], number) FROM numbers(10);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, char const*&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<char const*&>::type, std::type_identity<String>::type>, unsigned long&&, char const*&, String&&) @ 0x000000001f69fa7a in /usr/bin/clickhouse
3. DB::getArraysDepths(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, char const*) @ 0x000000001f69e57e in /usr/bin/clickhouse
4. DB::FunctionArrayEnumerateRankedExtended<DB::FunctionArrayEnumerateUniqRanked>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001f6d97d1 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:26:22.053344 [ 2861 ] {301dbc79-6af1-4f6f-b885-dac76146addf} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:48216). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:22.053349 [ 3987 ] {0725e354-f0ec-4b1a-bd19-fb5928d4e6c1} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:48148). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:22.053839 [ 3990 ] {71f53692-5208-497f-83bc-511443d5b50f} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:48172). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:22.053340 [ 3991 ] {bc57fe1a-af15-4449-9ff0-e9adb4bfe8e2} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:48182). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:23.238863 [ 3151 ] {c7082a54-c3db-42cd-b711-e7a357689fbe} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 13.25 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:23.239062 [ 3989 ] {a6153d08-1d95-4ce5-9b20-e4935fa7cd4a} <Error> TCPHandler: Code: 36. DB::Exception: Incorrect argument 2 type of function arrayEnumerateUniqRanked. Expected an Array or Const(UInt64), got UInt64: While processing arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]], number). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, char const*&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<char const*&>::type, std::type_identity<String>::type>, unsigned long&&, char const*&, String&&) @ 0x000000001f69fa7a in /usr/bin/clickhouse
3. DB::getArraysDepths(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, char const*) @ 0x000000001f69e57e in /usr/bin/clickhouse
4. DB::FunctionArrayEnumerateRankedExtended<DB::FunctionArrayEnumerateUniqRanked>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001f6d97d1 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:26:23.239075 [ 2861 ] {301dbc79-6af1-4f6f-b885-dac76146addf} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:48216). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::getQueryCancellationStatus() @ 0x000000003e0cc472 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:533: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::TCPHandler::runImpl()::$_10, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003e0f3a84 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:99: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f736a in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:546: DB::TCPHandler::runImpl() @ 0x000000003e0a8868 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:23.239102 [ 3990 ] {71f53692-5208-497f-83bc-511443d5b50f} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:48172). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::getQueryCancellationStatus() @ 0x000000003e0cc472 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:533: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::TCPHandler::runImpl()::$_10, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003e0f3a84 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:99: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f736a in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:546: DB::TCPHandler::runImpl() @ 0x000000003e0a8868 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:23.239125 [ 3991 ] {bc57fe1a-af15-4449-9ff0-e9adb4bfe8e2} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:48182). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::getQueryCancellationStatus() @ 0x000000003e0cc472 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:533: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::TCPHandler::runImpl()::$_10, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003e0f3a84 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:99: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f736a in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:546: DB::TCPHandler::runImpl() @ 0x000000003e0a8868 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:23.239140 [ 2759 ] {4eecb084-017d-4299-af3f-9b6b43f07854} <Error> executeQuery: Code: 48. DB::Exception: ReplicatedMergeTree (table test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf)) does not support transactions. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:51896) (comment: 00509_extended_storage_definition_syntax_zookeeper.sql) (in query: DROP DATABASE IF EXISTS test_kwrwlc1k ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000039617105 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/TypePromotion.h:26: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x000000003964792f in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:376: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x000000003965126b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000039645d0d in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643f56 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:23.240947 [ 3990 ] {71f53692-5208-497f-83bc-511443d5b50f} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:26:23.239176 [ 3987 ] {0725e354-f0ec-4b1a-bd19-fb5928d4e6c1} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:48148). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProfileEvents() @ 0x000000003e0d4b01 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8976 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:23.239562 [ 3207 ] {a2970563-8f8d-448d-96da-07d883574284} <Error> executeQuery: Code: 125. DB::Exception: Scalar subquery returned empty result of type Tuple(UInt8, String) which cannot be Nullable: While processing (WITH addressToSymbol(arrayJoin(trace)) AS symbol SELECT ignore(ignore(ignore(ignore(65536)), ignore(65537), ignore(2)), ''), query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (event_date >= yesterday()) AND (query LIKE '%test memory profiler%') ORDER BY event_time DESC LIMIT 1) AS _subquery35: While processing query_id = ((WITH addressToSymbol(arrayJoin(trace)) AS symbol SELECT ignore(ignore(ignore(ignore(65536)), ignore(65537), ignore(2)), ''), query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (event_date >= yesterday()) AND (query LIKE '%test memory profiler%') ORDER BY event_time DESC LIMIT 1) AS _subquery35): While processing greaterOrEquals(event_date, ignore(ignore(ignore(NULL, '')), 256), yesterday()) AND (trace_type = 'Memory') AND (query_id = ((WITH addressToSymbol(arrayJoin(trace)) AS symbol SELECT ignore(ignore(ignore(ignore(65536)), ignore(65537), ignore(2)), ''), query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (event_date >= yesterday()) AND (query LIKE '%test memory profiler%') ORDER BY event_time DESC LIMIT 1) AS _subquery35)). (INCORRECT_RESULT_OF_SCALAR_SUBQUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57262) (comment: 01651_bugs_from_15889.sql) (in query: WITH addressToSymbol(arrayJoin(trace)) AS symbol SELECT count() > 0 FROM trace_log AS t WHERE greaterOrEquals(event_date, ignore(ignore(ignore(NULL, '')), 256), yesterday()) AND (trace_type = 'Memory') AND (query_id = ( SELECT ignore(ignore(ignore(ignore(65536)), ignore(65537), ignore(2)), ''), query_id FROM system.query_log WHERE current_database = currentDatabase() AND (event_date >= yesterday()) AND (query LIKE '%test memory profiler%') ORDER BY event_time DESC LIMIT 1 ));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:204: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f721e0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f687be in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.h:35: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context const>, unsigned long, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, bool, bool) @ 0x000000003a70965e in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a6f91d4 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:26:23.251652 [ 3991 ] {bc57fe1a-af15-4449-9ff0-e9adb4bfe8e2} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:26:23.251662 [ 2861 ] {301dbc79-6af1-4f6f-b885-dac76146addf} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:26:23.253231 [ 3987 ] {0725e354-f0ec-4b1a-bd19-fb5928d4e6c1} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:26:23.254940 [ 3207 ] {a2970563-8f8d-448d-96da-07d883574284} <Error> TCPHandler: Code: 125. DB::Exception: Scalar subquery returned empty result of type Tuple(UInt8, String) which cannot be Nullable: While processing (WITH addressToSymbol(arrayJoin(trace)) AS symbol SELECT ignore(ignore(ignore(ignore(65536)), ignore(65537), ignore(2)), ''), query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (event_date >= yesterday()) AND (query LIKE '%test memory profiler%') ORDER BY event_time DESC LIMIT 1) AS _subquery35: While processing query_id = ((WITH addressToSymbol(arrayJoin(trace)) AS symbol SELECT ignore(ignore(ignore(ignore(65536)), ignore(65537), ignore(2)), ''), query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (event_date >= yesterday()) AND (query LIKE '%test memory profiler%') ORDER BY event_time DESC LIMIT 1) AS _subquery35): While processing greaterOrEquals(event_date, ignore(ignore(ignore(NULL, '')), 256), yesterday()) AND (trace_type = 'Memory') AND (query_id = ((WITH addressToSymbol(arrayJoin(trace)) AS symbol SELECT ignore(ignore(ignore(ignore(65536)), ignore(65537), ignore(2)), ''), query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (event_date >= yesterday()) AND (query LIKE '%test memory profiler%') ORDER BY event_time DESC LIMIT 1) AS _subquery35)). (INCORRECT_RESULT_OF_SCALAR_SUBQUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:204: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f721e0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f687be in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.h:35: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context const>, unsigned long, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, bool, bool) @ 0x000000003a70965e in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a6f91d4 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:26:23.255176 [ 2759 ] {4eecb084-017d-4299-af3f-9b6b43f07854} <Error> DynamicQueryHandler: Code: 48. DB::Exception: ReplicatedMergeTree (table test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf)) does not support transactions. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000039617105 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/TypePromotion.h:26: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x000000003964792f in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:376: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x000000003965126b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000039645d0d in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643f56 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:25.660270 [ 3983 ] {82b8a6d8-4db2-4ec4-8136-8085789beae1} <Error> executeQuery: Code: 403. DB::Exception: Cannot get JOIN keys from JOIN ON section: 'dummy = 1', found keys: [Left keys: [] Right keys [] Condition columns: '', 'equals(dummy, 1)']. (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34758) (comment: 01081_PartialSortingTransform_full_column.sql) (in query: select 1 from remote('127.{1,2}', currentDatabase(), test_01081) lhs join system.one as rhs on rhs.dummy = 1 order by 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:658: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a7037ce in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:27.356588 [ 3983 ] {82b8a6d8-4db2-4ec4-8136-8085789beae1} <Error> TCPHandler: Code: 403. DB::Exception: Cannot get JOIN keys from JOIN ON section: 'dummy = 1', found keys: [Left keys: [] Right keys [] Condition columns: '', 'equals(dummy, 1)']. (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:658: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a7037ce in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:27.357185 [ 2332 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:28.477091 [ 2759 ] {ce7c9806-04e0-4586-bcc9-39b5f3e590c1} <Error> executeQuery: Code: 507. DB::Exception: No sharding key. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43342) (comment: 01071_force_optimize_skip_unused_shards.sql) (in query: select * from dist_01071;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x00000000208396b7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69628 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:28.477137 [ 2950 ] {aa4d8c97-8758-4ca0-8820-c717038f621f} <Error> executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 583.00 MiB: While executing MergeTreeThread. (TOO_MANY_BYTES) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38958) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:28.485725 [ 2406 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:28.567152 [ 2759 ] {ce7c9806-04e0-4586-bcc9-39b5f3e590c1} <Error> TCPHandler: Code: 507. DB::Exception: No sharding key. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x00000000208396b7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69628 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:29.806453 [ 2950 ] {aa4d8c97-8758-4ca0-8820-c717038f621f} <Error> TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 583.00 MiB: While executing MergeTreeThread. (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:29.806484 [ 2759 ] {4e5d9b2b-4569-4a74-836e-a2393b0db346} <Error> executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43342) (comment: 01071_force_optimize_skip_unused_shards.sql) (in query: select * from dist_01071;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69b34 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:29.806539 [ 3983 ] {3f2bad7f-2ed7-45ca-9826-c70cc52290d0} <Error> executeQuery: Code: 403. DB::Exception: Cannot get JOIN keys from JOIN ON section: 'dummy = 1', found keys: [Left keys: [] Right keys [] Condition columns: '', 'equals(dummy, 1)']. (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34758) (comment: 01081_PartialSortingTransform_full_column.sql) (in query: select 1 from remote('127.{1,2}', currentDatabase(), test_01081) lhs join system.one as rhs on rhs.dummy = 1 order by 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:658: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a7037ce in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:30.736226 [ 3983 ] {3f2bad7f-2ed7-45ca-9826-c70cc52290d0} <Error> TCPHandler: Code: 403. DB::Exception: Cannot get JOIN keys from JOIN ON section: 'dummy = 1', found keys: [Left keys: [] Right keys [] Condition columns: '', 'equals(dummy, 1)']. (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:658: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a7037ce in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:30.736215 [ 2759 ] {4e5d9b2b-4569-4a74-836e-a2393b0db346} <Error> TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69b34 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:30.736504 [ 3107 ] {16dc2be8-ad04-4c56-b228-a5e2f3fff6b8} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 148.35 MiB (attempt to allocate chunk of 1703936 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34796) (comment: 00169_contingency.sql) (in query: WITH URLDomain AS a, URLDomain AS b SELECT round(cramersV(a, b), 2), round(cramersVBiasCorrected(a, b), 2), round(theilsU(a, b), 2), round(theilsU(b, a), 2), round(contingency(a, b), 2) FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9bb7 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/Allocator.h:0: HashTable<wide::integer<128ul, unsigned int>, HashMapCellWithSavedHash<wide::integer<128ul, unsigned int>, unsigned long, UInt128Hash, HashTableNoState>, UInt128Hash, HashTableGrower<4ul>, AllocatorWithStackMemory<Allocator<true, true>, 512ul, 1ul>>::resize(unsigned long, unsigned long) @ 0x0000000029deb298 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/HashTable/HashTable.h:236: DB::CrossTabData::add(unsigned long, unsigned long) @ 0x0000000029de8e7c in /usr/bin/clickhouse
9. ./build_docker/./src/AggregateFunctions/CrossTab.h:150: DB::AggregateFunctionCrossTab<DB::(anonymous namespace)::TheilsUData>::add(char*, DB::IColumn const**, unsigned long, DB::Arena*) const @ 0x0000000029df6563 in /usr/bin/clickhouse
10. ./build_docker/./src/AggregateFunctions/IAggregateFunction.h:541: DB::IAggregateFunctionHelper<DB::AggregateFunctionCrossTab<DB::(anonymous namespace)::TheilsUData>>::addBatchSinglePlace(unsigned long, unsigned long, char*, DB::IColumn const**, DB::Arena*, long) const @ 0x0000000029df8541 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeWithoutKeyImpl<false>(char*&, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, DB::Arena*) const @ 0x000000003806900f in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:1586: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037dea927 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:30.736581 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:31.559809 [ 3107 ] {16dc2be8-ad04-4c56-b228-a5e2f3fff6b8} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 148.35 MiB (attempt to allocate chunk of 1703936 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9bb7 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/Allocator.h:0: HashTable<wide::integer<128ul, unsigned int>, HashMapCellWithSavedHash<wide::integer<128ul, unsigned int>, unsigned long, UInt128Hash, HashTableNoState>, UInt128Hash, HashTableGrower<4ul>, AllocatorWithStackMemory<Allocator<true, true>, 512ul, 1ul>>::resize(unsigned long, unsigned long) @ 0x0000000029deb298 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/HashTable/HashTable.h:236: DB::CrossTabData::add(unsigned long, unsigned long) @ 0x0000000029de8e7c in /usr/bin/clickhouse
9. ./build_docker/./src/AggregateFunctions/CrossTab.h:150: DB::AggregateFunctionCrossTab<DB::(anonymous namespace)::TheilsUData>::add(char*, DB::IColumn const**, unsigned long, DB::Arena*) const @ 0x0000000029df6563 in /usr/bin/clickhouse
10. ./build_docker/./src/AggregateFunctions/IAggregateFunction.h:541: DB::IAggregateFunctionHelper<DB::AggregateFunctionCrossTab<DB::(anonymous namespace)::TheilsUData>>::addBatchSinglePlace(unsigned long, unsigned long, char*, DB::IColumn const**, DB::Arena*, long) const @ 0x0000000029df8541 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeWithoutKeyImpl<false>(char*&, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, DB::Arena*) const @ 0x000000003806900f in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:1586: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037dea927 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:31.579637 [ 3101 ] {2c1655ea-ae4a-4da0-9a5d-335397ea91b1} <Error> executeQuery: Code: 47. DB::Exception: Missing columns: 'x' while processing query: 'SELECT x FROM system.numbers LIMIT 1', required columns: 'x'. (UNKNOWN_IDENTIFIER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43520) (comment: 00002_system_numbers.sql) (in query: select x from system.numbers limit 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a70088d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:32.003962 [ 3101 ] {2c1655ea-ae4a-4da0-9a5d-335397ea91b1} <Error> TCPHandler: Code: 47. DB::Exception: Missing columns: 'x' while processing query: 'SELECT x FROM system.numbers LIMIT 1', required columns: 'x'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a70088d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:32.010766 [ 2759 ] {76566702-c420-465e-a377-fb2a3c288f60} <Error> executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43342) (comment: 01071_force_optimize_skip_unused_shards.sql) (in query: select * from dist_01071;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69b34 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:32.015466 [ 3982 ] {1a2439ed-47d1-43bc-9b41-ae62a843b8ad} <Error> executeQuery: Code: 358. DB::Exception: INTO OUTFILE is not allowed. (INTO_OUTFILE_NOT_ALLOWED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:36322) (comment: 00415_into_outfile.sh) (in query: SELECT 1, 2 INTO OUTFILE '/tmp/clickhouse-test/0_stateless/test_into_outfile_http.out'), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [28]>(int, char const (&) [28]) @ 0x000000000a282bf7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/executeQuery.cpp:1354: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9b1e66 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
5. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:32.015140 [ 2403 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:32.016585 [ 2759 ] {76566702-c420-465e-a377-fb2a3c288f60} <Error> TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69b34 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:32.027637 [ 3101 ] {3e5ba60a-19cf-45ee-91db-e4ff888c67f9} <Error> executeQuery: Code: 47. DB::Exception: Missing columns: 'x' while processing query: 'SELECT x, number FROM system.numbers LIMIT 1', required columns: 'x' 'number', maybe you meant: 'number'. (UNKNOWN_IDENTIFIER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43520) (comment: 00002_system_numbers.sql) (in query: SELECT x, number FROM system.numbers LIMIT 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a70088d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:32.028809 [ 3101 ] {3e5ba60a-19cf-45ee-91db-e4ff888c67f9} <Error> TCPHandler: Code: 47. DB::Exception: Missing columns: 'x' while processing query: 'SELECT x, number FROM system.numbers LIMIT 1', required columns: 'x' 'number', maybe you meant: 'number'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a70088d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:32.028806 [ 3982 ] {1a2439ed-47d1-43bc-9b41-ae62a843b8ad} <Error> DynamicQueryHandler: Code: 358. DB::Exception: INTO OUTFILE is not allowed. (INTO_OUTFILE_NOT_ALLOWED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [28]>(int, char const (&) [28]) @ 0x000000000a282bf7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/executeQuery.cpp:1354: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9b1e66 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
5. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:33.332032 [ 3982 ] {} <Error> ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000004a1dd7e3 in /usr/bin/clickhouse
1. ./build_docker/./base/poco/Net/src/NetException.cpp:0: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x0000000049d4732e in /usr/bin/clickhouse
2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000049d63a60 in /usr/bin/clickhouse
3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x0000000049d6884f in /usr/bin/clickhouse
4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x0000000049d78392 in /usr/bin/clickhouse
5. ./build_docker/./base/poco/Net/src/StreamSocket.cpp:114: Poco::Net::StreamSocket::sendBytes(void const*, int, int) @ 0x0000000049d7306e in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x0000000049d11c1c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:171: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x0000000049cce0ce in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<Poco::Net::HTTPChunkedOutputStream, std::allocator<Poco::Net::HTTPChunkedOutputStream>>::__on_zero_shared() @ 0x000000003e11a420 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerResponse::~HTTPServerResponse() @ 0x000000003e10ea98 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/atomic:958: DB::HTTPServerConnection::run() @ 0x000000003e10d8e0 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:34.475042 [ 3101 ] {8bfe7a80-59d5-4221-8c9f-5d990d5c88d7} <Error> executeQuery: Code: 60. DB::Exception: Table system.number does not exist. Maybe you meant numbers?. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43520) (comment: 00002_system_numbers.sql) (in query: SELECT * FROM system.number LIMIT 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000947c83e in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201cb3 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:35.327346 [ 2371 ] {} <Warning> test_hjvx8641.partitioned_by_string_replica1 (c022fbaa-11cb-4ec2-8d5c-649f662354fb): Node with parent zookeeper lock /clickhouse/zero_copy/zero_copy_s3/c022fbaa-11cb-4ec2-8d5c-649f662354fb/7d878f3d88441d2b3dc371e2a3050f6d_0_0_0/test_brf_cozawvmykdgrvufabdqfikzlkhlfx for part 7d878f3d88441d2b3dc371e2a3050f6d_0_0_0 doesn't exist (part was unlocked before), refuse to remove blobs
2024.09.24 02:26:35.602713 [ 3101 ] {8bfe7a80-59d5-4221-8c9f-5d990d5c88d7} <Error> TCPHandler: Code: 60. DB::Exception: Table system.number does not exist. Maybe you meant numbers?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000947c83e in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201cb3 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:35.602720 [ 3989 ] {} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000035e1bd4e in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1904: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x00000000378b8175 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x000000003e0df937 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x000000003e0bf4be in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:35.602915 [ 2950 ] {2bda97a4-1ca4-4c1f-bc6e-a96c9e4e3230} <Error> executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.78 MiB: While executing MergeTreeThread. (TOO_MANY_BYTES) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38958) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits PREWHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:35.708195 [ 2759 ] {5848e8be-718b-4344-b7bf-52d124c8d200} <Error> executeQuery: Code: 507. DB::Exception: Sharding key is not deterministic. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43342) (comment: 01071_force_optimize_skip_unused_shards.sql) (in query: select * from dist_01071 where key = 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [34]>(int, char const (&) [34]) @ 0x000000000a76ccb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69a37 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:35.708277 [ 2368 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:36.725909 [ 2759 ] {5848e8be-718b-4344-b7bf-52d124c8d200} <Error> TCPHandler: Code: 507. DB::Exception: Sharding key is not deterministic. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [34]>(int, char const (&) [34]) @ 0x000000000a76ccb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69a37 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:36.725963 [ 3101 ] {f451294b-d745-4f80-a337-d4cc84946229} <Error> executeQuery: Code: 60. DB::Exception: Table test_13.system does not exist. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43520) (comment: 00002_system_numbers.sql) (in query: SELECT * FROM system LIMIT 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:36.727033 [ 2950 ] {2bda97a4-1ca4-4c1f-bc6e-a96c9e4e3230} <Error> TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.78 MiB: While executing MergeTreeThread. (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:38.119798 [ 4002 ] {d8734ee4-346b-4e9b-b216-d0a1f1e89c1d} <Error> executeQuery: Code: 36. DB::Exception: Expression with arrayJoin cannot depend on lambda argument: array(x, 1): While processing arrayMap(x -> arrayJoin([x, 1]), [1, 2]). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53946) (comment: 01330_array_join_in_higher_order_function.sql) (in query: SELECT arrayMap(x -> arrayJoin([x, 1]), [1, 2]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:614: DB::ScopeStack::addArrayJoin(String const&, String) @ 0x0000000037d45b9d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d5c8e6 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d5ab29 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:26:38.122705 [ 3101 ] {f451294b-d745-4f80-a337-d4cc84946229} <Error> TCPHandler: Code: 60. DB::Exception: Table test_13.system does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:38.130527 [ 2443 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:38.132042 [ 4002 ] {d8734ee4-346b-4e9b-b216-d0a1f1e89c1d} <Error> TCPHandler: Code: 36. DB::Exception: Expression with arrayJoin cannot depend on lambda argument: array(x, 1): While processing arrayMap(x -> arrayJoin([x, 1]), [1, 2]). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:614: DB::ScopeStack::addArrayJoin(String const&, String) @ 0x0000000037d45b9d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d5c8e6 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d5ab29 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:26:38.147635 [ 3101 ] {2d217686-c39c-4293-9aa0-9ec7f2fa7a44} <Error> executeQuery: Code: 60. DB::Exception: Table test_13.numbers does not exist. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43520) (comment: 00002_system_numbers.sql) (in query: SELECT * FROM numbers LIMIT 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:38.154934 [ 3101 ] {2d217686-c39c-4293-9aa0-9ec7f2fa7a44} <Error> TCPHandler: Code: 60. DB::Exception: Table test_13.numbers does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:38.178842 [ 3101 ] {36965634-cd88-4ec1-adcf-d18caebae830} <Error> executeQuery: Code: 47. DB::Exception: Missing columns: 'sys.number' while processing query: 'SELECT sys.number FROM system.numbers AS sys_num LIMIT 1', required columns: 'sys.number'. (UNKNOWN_IDENTIFIER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43520) (comment: 00002_system_numbers.sql) (in query: SELECT sys.number FROM system.numbers AS sys_num LIMIT 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a70088d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:38.188323 [ 3101 ] {36965634-cd88-4ec1-adcf-d18caebae830} <Error> TCPHandler: Code: 47. DB::Exception: Missing columns: 'sys.number' while processing query: 'SELECT sys.number FROM system.numbers AS sys_num LIMIT 1', required columns: 'sys.number'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a70088d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:38.370960 [ 3139 ] {1934dd69-1daf-4200-b5cb-95f7a3ec37a2} <Error> executeQuery: Code: 507. DB::Exception: Sharding key modulo(sub_key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:45172) (comment: 01071_force_optimize_skip_unused_shards.sql) (in query: SELECT `dist2_layer_01071`.`key`, `dist2_layer_01071`.`sub_key` FROM `test_y39blbyj`.`dist2_layer_01071` WHERE `key` = 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69b34 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:38.372570 [ 3139 ] {1934dd69-1daf-4200-b5cb-95f7a3ec37a2} <Error> TCPHandler: Code: 507. DB::Exception: Sharding key modulo(sub_key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69b34 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:38.884496 [ 2759 ] {ff6d874e-7ccb-43d3-a1b4-8835f215576e} <Error> executeQuery: Code: 507. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Sharding key modulo(sub_key, 2) is not used. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69b34 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43342) (comment: 01071_force_optimize_skip_unused_shards.sql) (in query: select * from dist2_01071 where key = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:26:38.885903 [ 2759 ] {ff6d874e-7ccb-43d3-a1b4-8835f215576e} <Error> TCPHandler: Code: 507. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Sharding key modulo(sub_key, 2) is not used. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo const&) const @ 0x000000003bb69b34 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageDistributed.cpp:440: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&) const @ 0x000000003bb669ba in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5b86a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:26:40.219790 [ 2382 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:40.219931 [ 3207 ] {0cccac25-3ee0-47c6-9fb1-7f80302f002c} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Tuple(Float64, DateTime) of argument of function toDateTime: While processing if(dateDiff('second', toDateTime(_CAST('1727137583.26096', 'Nullable(DateTime64(6))') AS time_with_microseconds), toDateTime(__getScalar('328664473894676434_743697615286468304') AS t)) = -9223372036854775808, 'ok', ''). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57262) (comment: 01651_bugs_from_15889.sql) (in query: WITH ( ( SELECT query_start_time_microseconds FROM system.query_log WHERE current_database = currentDatabase() ORDER BY query_start_time DESC LIMIT 1 ) AS time_with_microseconds, ( SELECT inf, query_start_time FROM system.query_log WHERE current_database = currentDatabase() ORDER BY query_start_time DESC LIMIT 1 ) AS t) SELECT if(dateDiff('second', toDateTime(time_with_microseconds), toDateTime(t)) = -9223372036854775808, 'ok', '');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionConvert<DB::DataTypeDateTime, DB::NameToDateTime, DB::ToDateTimeMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009d5bb1b in /usr/bin/clickhouse
4. DB::FunctionConvert<DB::DataTypeDateTime, DB::NameToDateTime, DB::ToDateTimeMonotonicity>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009d59962 in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse

2024.09.24 02:26:40.221439 [ 3207 ] {0cccac25-3ee0-47c6-9fb1-7f80302f002c} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Tuple(Float64, DateTime) of argument of function toDateTime: While processing if(dateDiff('second', toDateTime(_CAST('1727137583.26096', 'Nullable(DateTime64(6))') AS time_with_microseconds), toDateTime(__getScalar('328664473894676434_743697615286468304') AS t)) = -9223372036854775808, 'ok', ''). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionConvert<DB::DataTypeDateTime, DB::NameToDateTime, DB::ToDateTimeMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009d5bb1b in /usr/bin/clickhouse
4. DB::FunctionConvert<DB::DataTypeDateTime, DB::NameToDateTime, DB::ToDateTimeMonotonicity>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009d59962 in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse

2024.09.24 02:26:40.849479 [ 2458 ] {} <Warning> test_hjvx8641.without_fixed_size_columns_replica1 (2c42d8ea-d49e-4156-a8b7-7cef11f79bc9): Node with parent zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2c42d8ea-d49e-4156-a8b7-7cef11f79bc9/1_0_0_0/test_lcd_isysvowovzkrrdbgwwpgclunchlxp for part 1_0_0_0 doesn't exist (part was unlocked before), refuse to remove blobs
2024.09.24 02:26:41.224742 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:42.231027 [ 2353 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:43.244228 [ 2356 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:44.291020 [ 2438 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:45.296794 [ 2450 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:46.830847 [ 3107 ] {ea94d38a-a098-46ab-a9f8-0384b549cac2} <Warning> DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments
2024.09.24 02:26:46.876940 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:46.877026 [ 3151 ] {609c7762-52b9-4cd9-912f-1cd461ff9381} <Error> executeQuery: Code: 117. DB::Exception: Incorrect state of aggregate function 'nothing', it should contain exactly one zero byte, while it is 1.: While processing CAST('
\0', 'AggregateFunction(nothingArrayIf, Array(Nullable(Nothing)), Nullable(Nothing))'). (INCORRECT_DATA) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:37932) (comment: 02731_nothing_deserialization.sql) (in query: SELECT CAST('\x01\x00' AS AggregateFunction(nothingArrayIf, Array(Nullable(Nothing)), Nullable(Nothing)));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned int>(int, FormatStringHelperImpl<std::type_identity<unsigned int>::type>, unsigned int&&) @ 0x000000002a794437 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionNothing.h:78: DB::AggregateFunctionNothing::deserialize(char*, DB::ReadBuffer&, std::optional<unsigned long>, DB::Arena*) const @ 0x000000002a793002 in /usr/bin/clickhouse
4. ./build_docker/./src/AggregateFunctions/AggregateFunctionArray.h:159: DB::AggregateFunctionArray::deserialize(char*, DB::ReadBuffer&, std::optional<unsigned long>, DB::Arena*) const @ 0x000000002ae1a935 in /usr/bin/clickhouse
5. ./build_docker/./src/AggregateFunctions/AggregateFunctionIf.h:181: DB::AggregateFunctionIf::deserialize(char*, DB::ReadBuffer&, std::optional<unsigned long>, DB::Arena*) const @ 0x000000002adc3535 in /usr/bin/clickhouse
6. ./build_docker/./src/AggregateFunctions/AggregateFunctionNull.h:177: DB::AggregateFunctionNullBase<false, false, DB::AggregateFunctionIfNullVariadic<false, false>>::deserialize(char*, DB::ReadBuffer&, std::optional<unsigned long>, DB::Arena*) const @ 0x000000002ae0c2b9 in /usr/bin/clickhouse
7. ./build_docker/./src/DataTypes/Serializations/SerializationAggregateFunction.cpp:0: DB::deserializeFromString(std::shared_ptr<DB::IAggregateFunction const> const&, DB::IColumn&, String const&, unsigned long) @ 0x0000000036ecf6bb in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::SerializationAggregateFunction::deserializeWholeText(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const @ 0x0000000036ecff5c in /usr/bin/clickhouse
9. DB::ConvertImplGenericFromString<DB::ColumnString>::executeImpl(DB::IColumn const&, DB::IColumn&, DB::ISerialization const&, unsigned long, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, DB::IDataType const*) @ 0x000000000943a8d9 in /usr/bin/clickhouse
10. DB::ConvertImplGenericFromString<DB::ColumnString>::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long) @ 0x000000000943916a in /usr/bin/clickhouse
11. COW<DB::IColumn>::immutable_ptr<DB::IColumn> std::__function::__policy_invoker<COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)>::__call_impl<std::__function::__default_alloc_func<COW<DB::IColumn>::immutable_ptr<DB::IColumn> (*)(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long), COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)>>(std::__function::__policy_storage const*, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long) @ 0x00000000094428ba in /usr/bin/clickhouse
12. DB::ExecutableFunctionCast::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000094107f8 in /usr/bin/clickhouse
13. DB::IExecutableFunction::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000094111c2 in /usr/bin/clickhouse
14. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
15. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
16. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
17. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2303 in /usr/bin/clickhouse
18. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse

2024.09.24 02:26:48.079505 [ 3151 ] {609c7762-52b9-4cd9-912f-1cd461ff9381} <Error> TCPHandler: Code: 117. DB::Exception: Incorrect state of aggregate function 'nothing', it should contain exactly one zero byte, while it is 1.: While processing CAST('
\0', 'AggregateFunction(nothingArrayIf, Array(Nullable(Nothing)), Nullable(Nothing))'). (INCORRECT_DATA), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned int>(int, FormatStringHelperImpl<std::type_identity<unsigned int>::type>, unsigned int&&) @ 0x000000002a794437 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionNothing.h:78: DB::AggregateFunctionNothing::deserialize(char*, DB::ReadBuffer&, std::optional<unsigned long>, DB::Arena*) const @ 0x000000002a793002 in /usr/bin/clickhouse
4. ./build_docker/./src/AggregateFunctions/AggregateFunctionArray.h:159: DB::AggregateFunctionArray::deserialize(char*, DB::ReadBuffer&, std::optional<unsigned long>, DB::Arena*) const @ 0x000000002ae1a935 in /usr/bin/clickhouse
5. ./build_docker/./src/AggregateFunctions/AggregateFunctionIf.h:181: DB::AggregateFunctionIf::deserialize(char*, DB::ReadBuffer&, std::optional<unsigned long>, DB::Arena*) const @ 0x000000002adc3535 in /usr/bin/clickhouse
6. ./build_docker/./src/AggregateFunctions/AggregateFunctionNull.h:177: DB::AggregateFunctionNullBase<false, false, DB::AggregateFunctionIfNullVariadic<false, false>>::deserialize(char*, DB::ReadBuffer&, std::optional<unsigned long>, DB::Arena*) const @ 0x000000002ae0c2b9 in /usr/bin/clickhouse
7. ./build_docker/./src/DataTypes/Serializations/SerializationAggregateFunction.cpp:0: DB::deserializeFromString(std::shared_ptr<DB::IAggregateFunction const> const&, DB::IColumn&, String const&, unsigned long) @ 0x0000000036ecf6bb in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::SerializationAggregateFunction::deserializeWholeText(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const @ 0x0000000036ecff5c in /usr/bin/clickhouse
9. DB::ConvertImplGenericFromString<DB::ColumnString>::executeImpl(DB::IColumn const&, DB::IColumn&, DB::ISerialization const&, unsigned long, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, DB::IDataType const*) @ 0x000000000943a8d9 in /usr/bin/clickhouse
10. DB::ConvertImplGenericFromString<DB::ColumnString>::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long) @ 0x000000000943916a in /usr/bin/clickhouse
11. COW<DB::IColumn>::immutable_ptr<DB::IColumn> std::__function::__policy_invoker<COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)>::__call_impl<std::__function::__default_alloc_func<COW<DB::IColumn>::immutable_ptr<DB::IColumn> (*)(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long), COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)>>(std::__function::__policy_storage const*, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long) @ 0x00000000094428ba in /usr/bin/clickhouse
12. DB::ExecutableFunctionCast::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000094107f8 in /usr/bin/clickhouse
13. DB::IExecutableFunction::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000094111c2 in /usr/bin/clickhouse
14. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
15. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
16. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
17. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2303 in /usr/bin/clickhouse
18. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse

2024.09.24 02:26:48.079605 [ 3107 ] {ea94d38a-a098-46ab-a9f8-0384b549cac2} <Error> executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38000) (comment: 02442_auxiliary_zookeeper_endpoint_id.sql) (in query: CREATE TABLE t1_r1 (`x` Int32) ENGINE = ReplicatedMergeTree('/test/02442/{database}/t', 'r1') ORDER BY x SETTINGS index_granularity = 25561, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 11359, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 5764904215, index_granularity_bytes = 19586391, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 57041, primary_key_compress_block_size = 42018), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:48.080601 [ 2861 ] {af7f2847-531d-440e-ae3e-9cf0a195a21a} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 70.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column WatchID): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:54098) (comment: 00158_cache_dictionary_has.sql) (in query: SELECT sum(flag) FROM (SELECT dictHas('db_dict.cache_hits', toUInt64(WatchID)) as flag FROM test.hits PREWHERE WatchID % 1400 == 0 LIMIT 100);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
18. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/deque:1902: DB::MergeTreeReaderWide::prefetchBeginOfRange(Priority) @ 0x000000003d4aca14 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreePrefetchedReadPool.cpp:0: std::__packaged_task_func<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'()>, std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>> ()>::operator()() @ 0x000000003f25bd51 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>> ()>::operator()() @ 0x000000003f26a692 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003f25c3ae in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:49.040023 [ 2372 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:49.042786 [ 3107 ] {ea94d38a-a098-46ab-a9f8-0384b549cac2} <Error> TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:49.042814 [ 2861 ] {af7f2847-531d-440e-ae3e-9cf0a195a21a} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 70.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column WatchID): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
18. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/deque:1902: DB::MergeTreeReaderWide::prefetchBeginOfRange(Priority) @ 0x000000003d4aca14 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreePrefetchedReadPool.cpp:0: std::__packaged_task_func<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'()>, std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>> ()>::operator()() @ 0x000000003f25bd51 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>> ()>::operator()() @ 0x000000003f26a692 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::unique_ptr<DB::IMergeTreeReader, std::default_delete<DB::IMergeTreeReader>>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::AlterConversions const> const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003f25c3ae in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:49.042892 [ 3101 ] {e0ca5107-27c6-478c-9767-8c33d28252d1} <Error> executeQuery: Code: 48. DB::Exception: Can't execute FULL_SORTING_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38022) (comment: 01010_partial_merge_join_const_and_lc.sql) (in query: select s1.x, s2.x from (select 1 as x) s1 left join (select 1 as x) s2 using x;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:49.061685 [ 3101 ] {e0ca5107-27c6-478c-9767-8c33d28252d1} <Error> TCPHandler: Code: 48. DB::Exception: Can't execute FULL_SORTING_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:50.845360 [ 3182 ] {454705f0-529e-49f3-ba79-605ce246b24c} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 1.54 GiB (attempt to allocate chunk of 1050750 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57308) (comment: 00157_cache_dictionary.sql) (in query: INSERT INTO test.hits_1m SELECT * FROM test.hits LIMIT 1000000;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:72: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f86a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed7d42 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse

2024.09.24 02:26:50.851459 [ 2467 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:51.902863 [ 2432 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:52.945141 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:53.977000 [ 2341 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:55.015036 [ 2353 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:56.252670 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:56.328768 [ 3182 ] {454705f0-529e-49f3-ba79-605ce246b24c} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 1.54 GiB (attempt to allocate chunk of 1050750 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:72: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f86a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed7d42 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse

2024.09.24 02:26:57.311928 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:58.154698 [ 3980 ] {dc7c3957-96e7-471d-b1e8-83a261abe6cd} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38140) (comment: 01477_lc_in_merge_join_left_key.gen.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:58.223486 [ 3980 ] {dc7c3957-96e7-471d-b1e8-83a261abe6cd} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:26:58.315031 [ 2425 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:26:59.326693 [ 2406 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:00.327914 [ 2382 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:04.559105 [ 2861 ] {be1b2fd1-545d-4291-87ed-3c5fb9338741} <Error> executeQuery: Code: 503. DB::Exception: Aggregate function aggThrow has thrown exception successfully: While executing AggregatingTransform. (AGGREGATE_FUNCTION_THROW) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39256) (comment: 02963_msan_agg_addBatchLookupTable8.sql) (in query: -- https://github.com/ClickHouse/ClickHouse/issues/58727
 SELECT number % 2 AS even, aggThrow(number) FROM numbers(10) GROUP BY even;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionAggThrow.cpp:71: DB::(anonymous namespace)::AggregateFunctionThrow::create(char*) const @ 0x000000002a6e6bbb in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Aggregator.cpp:926: void DB::Aggregator::createAggregateStates<false>(char*&) const @ 0x0000000038059408 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Aggregator.cpp:1169: void std::__invoke_void_return_wrapper<void, true>::__call<void DB::Aggregator::executeImplBatch<false, false, false, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const::'lambda'(char*&)&, char*&>(void DB::Aggregator::executeImplBatch<false, false, false, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const::'lambda'(char*&)&, char*&) @ 0x000000003832cc54 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void (char*&)>::__call_impl<std::__function::__default_alloc_func<void DB::Aggregator::executeImplBatch<false, false, false, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const::'lambda'(char*&), void (char*&)>>(std::__function::__policy_storage const*, char*&) @ 0x000000003832c809 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::IAggregateFunctionDataHelper<DB::(anonymous namespace)::AggregateFunctionThrowData, DB::(anonymous namespace)::AggregateFunctionThrow>::addBatchLookupTable8(unsigned long, unsigned long, char**, unsigned long, std::function<void (char*&)>, char8_t const*, DB::IColumn const**, DB::Arena*) const @ 0x000000002a6e7e65 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:1160: void DB::Aggregator::executeImplBatch<false, false, false, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000383296c8 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl<DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::Arena*, unsigned long, unsigned long, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000003805993a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x0000000037dde41a in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037dea9e8 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
18. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:04.560373 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:04.571830 [ 2861 ] {be1b2fd1-545d-4291-87ed-3c5fb9338741} <Error> TCPHandler: Code: 503. DB::Exception: Aggregate function aggThrow has thrown exception successfully: While executing AggregatingTransform. (AGGREGATE_FUNCTION_THROW), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionAggThrow.cpp:71: DB::(anonymous namespace)::AggregateFunctionThrow::create(char*) const @ 0x000000002a6e6bbb in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Aggregator.cpp:926: void DB::Aggregator::createAggregateStates<false>(char*&) const @ 0x0000000038059408 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Aggregator.cpp:1169: void std::__invoke_void_return_wrapper<void, true>::__call<void DB::Aggregator::executeImplBatch<false, false, false, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const::'lambda'(char*&)&, char*&>(void DB::Aggregator::executeImplBatch<false, false, false, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const::'lambda'(char*&)&, char*&) @ 0x000000003832cc54 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void (char*&)>::__call_impl<std::__function::__default_alloc_func<void DB::Aggregator::executeImplBatch<false, false, false, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const::'lambda'(char*&), void (char*&)>>(std::__function::__policy_storage const*, char*&) @ 0x000000003832c809 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::IAggregateFunctionDataHelper<DB::(anonymous namespace)::AggregateFunctionThrowData, DB::(anonymous namespace)::AggregateFunctionThrow>::addBatchLookupTable8(unsigned long, unsigned long, char**, unsigned long, std::function<void (char*&)>, char8_t const*, DB::IColumn const**, DB::Arena*) const @ 0x000000002a6e7e65 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:1160: void DB::Aggregator::executeImplBatch<false, false, false, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000383296c8 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl<DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(DB::AggregationMethodOneNumber<char8_t, FixedHashMap<char8_t, char*, FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>, FixedHashTableCalculatedSize<FixedHashMapImplicitZeroCell<char8_t, char*, HashTableNoState>>, Allocator<true, true>>, false, false>&, DB::Arena*, unsigned long, unsigned long, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000003805993a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x0000000037dde41a in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037dea9e8 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
18. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:05.791087 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:05.791503 [ 3992 ] {9fe65695-f7c3-40a9-b0a9-fe730ec21383} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 59.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column WatchID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 64222): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38154) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT RegionID, uniqCombined(WatchID) AS X FROM remote('127.0.0.{1,2}', test, hits) GROUP BY RegionID HAVING X > 100000 ORDER BY RegionID ASC;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
17. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse

2024.09.24 02:27:06.562098 [ 3983 ] {09c117ae-4182-4d6d-9611-ed45837ceb43} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:51762). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51762) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT `RegionID`, uniqCombined(`WatchID`) AS `X` FROM `test`.`hits` GROUP BY `RegionID` HAVING `X` > 100000 ORDER BY `RegionID` ASC), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:06.687387 [ 3983 ] {09c117ae-4182-4d6d-9611-ed45837ceb43} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:51762). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:06.689217 [ 3983 ] {09c117ae-4182-4d6d-9611-ed45837ceb43} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:51762). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:06.694035 [ 3983 ] {09c117ae-4182-4d6d-9611-ed45837ceb43} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:27:06.794488 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:07.243061 [ 3992 ] {9fe65695-f7c3-40a9-b0a9-fe730ec21383} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 59.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column WatchID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 64222): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
17. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse

2024.09.24 02:27:07.814987 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:08.821197 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:09.878891 [ 2441 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:10.896042 [ 2456 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:11.645209 [ 3101 ] {a22e6a4d-5192-4391-8f92-5a7ec9d8ed1a} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 95.39 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:52144) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:11.964878 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:13.922677 [ 2353 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:13.930432 [ 2759 ] {3e40c0fb-c5f7-4046-a3b5-e8a3f6cfede4} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 9.19 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column SendTiming): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 120 with max_rows_to_read = 43899): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:47380) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:27:15.949111 [ 3976 ] {2c773e3b-5fe1-4177-8886-58399d2c1d96} <Error> executeQuery: Code: 44. DB::Exception: Sorting key contains nullable columns, but merge tree setting `allow_nullable_key` is disabled. (ILLEGAL_COLUMN) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44808) (comment: 02920_alter_column_of_projections.sql) (in query: CREATE TABLE t (`uid` Int16, `name` String, `age` Nullable(Int8), `i` Int16, `j` Int16, PROJECTION p1 (SELECT name, age, uniq(i), count(j) GROUP BY name, age)) ENGINE = MergeTree ORDER BY uid SETTINGS index_granularity = 1, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 8163, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 516148, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 53035, primary_key_compress_block_size = 86119), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::checkKeyExpression(DB::ExpressionActions const&, DB::Block const&, String const&, bool) @ 0x000000003ce4f754 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeTreeData::checkProperties(DB::StorageInMemoryMetadata const&, DB::StorageInMemoryMetadata const&, bool, bool, std::shared_ptr<DB::Context const>) const @ 0x000000003ce4bea2 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__hash_table:1116: DB::MergeTreeData::checkProperties(DB::StorageInMemoryMetadata const&, DB::StorageInMemoryMetadata const&, bool, bool, std::shared_ptr<DB::Context const>) const @ 0x000000003ce4bcac in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:621: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, bool, std::function<void (String const&)>) @ 0x000000003ce3ed1d in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da1661b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:15.956800 [ 3981 ] {30bb272b-c145-4da2-a01b-d1451cfd6a62} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 97.42 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:38690) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:15.961567 [ 6598 ] {11bde8fc-47fd-466b-8731-6f8a013535ac} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 103.45 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:50464) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:15.966272 [ 2759 ] {3e40c0fb-c5f7-4046-a3b5-e8a3f6cfede4} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 9.19 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column SendTiming): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 120 with max_rows_to_read = 43899): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:27:15.966651 [ 3976 ] {2c773e3b-5fe1-4177-8886-58399d2c1d96} <Error> TCPHandler: Code: 44. DB::Exception: Sorting key contains nullable columns, but merge tree setting `allow_nullable_key` is disabled. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::checkKeyExpression(DB::ExpressionActions const&, DB::Block const&, String const&, bool) @ 0x000000003ce4f754 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeTreeData::checkProperties(DB::StorageInMemoryMetadata const&, DB::StorageInMemoryMetadata const&, bool, bool, std::shared_ptr<DB::Context const>) const @ 0x000000003ce4bea2 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__hash_table:1116: DB::MergeTreeData::checkProperties(DB::StorageInMemoryMetadata const&, DB::StorageInMemoryMetadata const&, bool, bool, std::shared_ptr<DB::Context const>) const @ 0x000000003ce4bcac in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:621: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, bool, std::function<void (String const&)>) @ 0x000000003ce3ed1d in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da1661b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:15.968653 [ 6599 ] {8e18adfc-7698-486f-a26c-beadfb410e35} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 17.19 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column SendTiming): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 288 with max_rows_to_read = 43899): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39774) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:27:15.971369 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:17.010210 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:18.048163 [ 2438 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:19.066917 [ 2422 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:22.302361 [ 2384 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:22.302372 [ 6599 ] {8e18adfc-7698-486f-a26c-beadfb410e35} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 17.19 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column SendTiming): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 288 with max_rows_to_read = 43899): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:27:22.736768 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/udh/ouvuzksihhkhstpjzkdrkhlnhmkov, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 4fa12989-3ed3-49ae-8d37-55882063e401, upload has finished false.
2024.09.24 02:27:22.746165 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/udh/ouvuzksihhkhstpjzkdrkhlnhmkov, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 4fa12989-3ed3-49ae-8d37-55882063e401, upload has finished false
2024.09.24 02:27:22.887708 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/udh/ouvuzksihhkhstpjzkdrkhlnhmkov, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 4fa12989-3ed3-49ae-8d37-55882063e401, upload has finished false
2024.09.24 02:27:22.907167 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/gwi/dpegarvubdisqvhbnyryfpgduhxdp, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id c9b0a748-f68d-4f48-9fe2-4222ea7c0197, upload has finished false.
2024.09.24 02:27:22.907255 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/gwi/dpegarvubdisqvhbnyryfpgduhxdp, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id c9b0a748-f68d-4f48-9fe2-4222ea7c0197, upload has finished false
2024.09.24 02:27:22.924853 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/gwi/dpegarvubdisqvhbnyryfpgduhxdp, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id c9b0a748-f68d-4f48-9fe2-4222ea7c0197, upload has finished false
2024.09.24 02:27:23.358704 [ 3101 ] {a22e6a4d-5192-4391-8f92-5a7ec9d8ed1a} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 95.39 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:23.362690 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 4214317 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:24.560113 [ 2118 ] {7f1b3c39-a060-42c0-bab9-bf951ead19ce} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 33554432 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 105.0865987141927, avg_chars_size = 116.50391845703123, limit = 196608): (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 196 with max_rows_to_read = 196608): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39272) (comment: 00162_mmap_compression_none.sql) (in query: INSERT INTO hits_none SELECT Title FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:24.560347 [ 3981 ] {30bb272b-c145-4da2-a01b-d1451cfd6a62} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 97.42 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:24.560588 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:24.563409 [ 6598 ] {11bde8fc-47fd-466b-8731-6f8a013535ac} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 103.45 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:24.565514 [ 3994 ] {9c879282-415e-4c97-afee-4cfb23525428} <Error> executeQuery: Code: 241. DB::Exception: Received from 127.0.0.6:9000. DB::Exception: Memory tracker (for query): fault injected. Would use 9.19 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column SendTiming): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 120 with max_rows_to_read = 43899): While executing MergeTreeThread. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44676) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT sum(cityHash64(*)) FROM (SELECT CounterID, quantileTiming(0.5)(SendTiming), count() FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) WHERE SendTiming != -1 GROUP BY CounterID);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:27:24.565475 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1114112 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column EndURL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_1_1_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 35 with max_rows_to_read = 6682): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:612: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForOneColumn() const @ 0x000000003cddd35f in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:842: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::VerticalMergeStage::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8ed8 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000003cde562e in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.052040 [ 6598 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:50464). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.069552 [ 6597 ] {c617ef5f-1010-40ae-bc4b-b056864ba21c} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:43012). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43012) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:25.073520 [ 3983 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:37198). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.540418 [ 3992 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:50632). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.540465 [ 3107 ] {81a0b95f-cdad-449a-98a6-462c0c407f43} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:60664). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60664) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3576 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:25.542900 [ 6599 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:39774). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.543217 [ 2118 ] {7f1b3c39-a060-42c0-bab9-bf951ead19ce} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 33554432 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 105.0865987141927, avg_chars_size = 116.50391845703123, limit = 196608): (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 196 with max_rows_to_read = 196608): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:25.543303 [ 3101 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52144). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.548613 [ 3981 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:38690). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.562856 [ 2372 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.725928 [ 6597 ] {c617ef5f-1010-40ae-bc4b-b056864ba21c} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:43012). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.726222 [ 6597 ] {c617ef5f-1010-40ae-bc4b-b056864ba21c} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:43012). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:25.730846 [ 3994 ] {9c879282-415e-4c97-afee-4cfb23525428} <Error> TCPHandler: Code: 241. DB::Exception: Received from 127.0.0.6:9000. DB::Exception: Memory tracker (for query): fault injected. Would use 9.19 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column SendTiming): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 120 with max_rows_to_read = 43899): While executing MergeTreeThread. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:27:25.745790 [ 6597 ] {c617ef5f-1010-40ae-bc4b-b056864ba21c} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:27:25.999285 [ 3107 ] {81a0b95f-cdad-449a-98a6-462c0c407f43} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:60664). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:25.999525 [ 3107 ] {81a0b95f-cdad-449a-98a6-462c0c407f43} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:60664). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3576 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:26.000049 [ 3107 ] {81a0b95f-cdad-449a-98a6-462c0c407f43} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:27:26.563548 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:27.564839 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:28.611404 [ 2395 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:29.668811 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:33.134935 [ 2336 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:34.145435 [ 2377 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:35.173091 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:36.186354 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:37.197478 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:38.207155 [ 2457 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:39.227400 [ 2460 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:40.246608 [ 2349 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:41.274845 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:42.275558 [ 2434 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:43.622153 [ 6603 ] {ba37ddd0-c859-4931-89f3-09592c83c60a} <Error> executeQuery: Code: 80. DB::Exception: Ordinary database engine does not support UUID. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50874) (comment: 01192_rename_database_zookeeper.sh) (in query: CREATE DATABASE test_01192 UUID '00001192-0000-4000-8000-000000000001' ENGINE=Ordinary), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [47]>(int, char const (&) [47]) @ 0x0000000009e087b7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:224: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ddce in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:44.238708 [ 3983 ] {12a3444f-a72f-42d5-a885-90732ebe6d40} <Error> executeQuery: Code: 191. DB::Exception: Limit for JOIN exceeded, max rows: 1.00 thousand, current rows: 1.03 thousand: While executing FillingRightJoinSide. (SET_SIZE_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50752) (comment: 00074_full_join.sql) (in query: SELECT CounterID, hits, visits FROM ( SELECT (CounterID % 100000) AS CounterID, count() AS hits FROM test.hits GROUP BY CounterID ) ANY FULL OUTER JOIN ( SELECT (CounterID % 100000) AS CounterID, sum(Sign) AS visits FROM test.visits GROUP BY CounterID HAVING visits > 0 ) USING CounterID WHERE hits = 0 OR visits = 0 ORDER BY hits + visits * 10 DESC, CounterID ASC LIMIT 20;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/HashJoin.cpp:0: DB::HashJoin::addBlockToJoin(DB::Block const&, bool) @ 0x0000000038d6292b in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/JoiningTransform.cpp:307: DB::FillingRightJoinSideTransform::work() @ 0x000000003ebc86cd in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:44.238853 [ 6603 ] {ba37ddd0-c859-4931-89f3-09592c83c60a} <Error> TCPHandler: Code: 80. DB::Exception: Ordinary database engine does not support UUID. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [47]>(int, char const (&) [47]) @ 0x0000000009e087b7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:224: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ddce in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:44.238914 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:45.255792 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:45.260603 [ 3983 ] {12a3444f-a72f-42d5-a885-90732ebe6d40} <Error> TCPHandler: Code: 191. DB::Exception: Limit for JOIN exceeded, max rows: 1.00 thousand, current rows: 1.03 thousand: While executing FillingRightJoinSide. (SET_SIZE_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/HashJoin.cpp:0: DB::HashJoin::addBlockToJoin(DB::Block const&, bool) @ 0x0000000038d6292b in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/JoiningTransform.cpp:307: DB::FillingRightJoinSideTransform::work() @ 0x000000003ebc86cd in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:46.260125 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:47.267232 [ 2324 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:48.707783 [ 2759 ] {f41ec22f-47f8-4d25-8004-50f00edb81dd} <Error> executeQuery: Code: 82. DB::Exception: Database default already exists. (DATABASE_ALREADY_EXISTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:51302) (comment: 01192_rename_database_zookeeper.sh) (in query: RENAME DATABASE test_01192 TO default), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:528: DB::DatabaseCatalog::assertDatabaseDoesntExistUnlocked(String const&) const @ 0x0000000037ad94ce in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::DatabaseCatalog::assertDatabaseDoesntExist(String const&) const @ 0x0000000037ad91e9 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::executeToDatabase(DB::ASTRenameQuery const&, std::vector<DB::RenameDescription, std::allocator<DB::RenameDescription>> const&) @ 0x0000000039afae3b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:73: DB::InterpreterRenameQuery::execute() @ 0x0000000039af6e61 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:48.709261 [ 2322 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:48.709418 [ 6597 ] {4362fcbb-df19-44c7-8dfc-e5bfef55e164} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 156.15 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:51222) (comment: 00078_group_by_arrays.sql) (in query: SELECT GoalsReached AS k, count() AS c FROM test.hits GROUP BY k ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:48.796295 [ 2759 ] {f41ec22f-47f8-4d25-8004-50f00edb81dd} <Error> TCPHandler: Code: 82. DB::Exception: Database default already exists. (DATABASE_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:528: DB::DatabaseCatalog::assertDatabaseDoesntExistUnlocked(String const&) const @ 0x0000000037ad94ce in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::DatabaseCatalog::assertDatabaseDoesntExist(String const&) const @ 0x0000000037ad91e9 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::executeToDatabase(DB::ASTRenameQuery const&, std::vector<DB::RenameDescription, std::allocator<DB::RenameDescription>> const&) @ 0x0000000039afae3b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:73: DB::InterpreterRenameQuery::execute() @ 0x0000000039af6e61 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:49.260297 [ 6597 ] {4362fcbb-df19-44c7-8dfc-e5bfef55e164} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 156.15 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:49.732842 [ 3107 ] {bb010d66-f36b-4dfb-89e5-72d643ffe8b9} <Error> executeQuery: Code: 81. DB::Exception: Database test_01192_notexisting does not exist. (UNKNOWN_DATABASE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:51340) (comment: 01192_rename_database_zookeeper.sh) (in query: RENAME DATABASE test_01192_notexisting TO test_01192_renamed), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:650: DB::DatabaseCatalog::getDatabase(String const&) const @ 0x0000000037adfc1c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:173: DB::InterpreterRenameQuery::executeToDatabase(DB::ASTRenameQuery const&, std::vector<DB::RenameDescription, std::allocator<DB::RenameDescription>> const&) @ 0x0000000039afad98 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:73: DB::InterpreterRenameQuery::execute() @ 0x0000000039af6e61 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:49.735446 [ 3107 ] {bb010d66-f36b-4dfb-89e5-72d643ffe8b9} <Error> TCPHandler: Code: 81. DB::Exception: Database test_01192_notexisting does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:650: DB::DatabaseCatalog::getDatabase(String const&) const @ 0x0000000037adfc1c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:173: DB::InterpreterRenameQuery::executeToDatabase(DB::ASTRenameQuery const&, std::vector<DB::RenameDescription, std::allocator<DB::RenameDescription>> const&) @ 0x0000000039afad98 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:73: DB::InterpreterRenameQuery::execute() @ 0x0000000039af6e61 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:27:49.794080 [ 2317 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:50.794966 [ 2404 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:51.850765 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:52.859105 [ 2441 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:53.905284 [ 2456 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:54.948221 [ 2340 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:56.008413 [ 2357 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:57.057483 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:58.115753 [ 2381 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:27:59.156067 [ 2390 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:00.167923 [ 2403 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:01.191197 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:02.213073 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:03.228479 [ 2384 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:04.255940 [ 2345 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:05.268926 [ 2361 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:06.281995 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:07.284737 [ 2434 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:08.322443 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:09.338678 [ 2402 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:10.340278 [ 2382 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:11.365875 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:12.404606 [ 2462 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:13.430732 [ 2325 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:14.439475 [ 2366 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:15.451869 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:15.568876 [ 3232 ] {b18190ba-3d9e-42a8-b4b8-97831e2db0ae} <Warning> test_rhy6tku0.table_one (47548fdf-095c-4aff-ae8a-a0fd5ba5b986): Table can't create parts with adaptive granularity, but settings min_rows_for_wide_part = 0, min_bytes_for_wide_part = 100. Parts with non-adaptive granularity can be stored only in Wide (default) format. Settings 'min_rows_for_wide_part'and 'min_bytes_for_wide_part' will be ignored.
2024.09.24 02:28:16.460357 [ 2436 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:17.467669 [ 2392 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:18.469075 [ 2325 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:21.164696 [ 3139 ] {a02762c8-46b2-414a-a459-3e47cc6921e4} <Error> executeQuery: Code: 43. DB::Exception: Function transform has signature: transform(T, Array(T), Array(U), U) -> U; or transform(T, Array(T), Array(T)) -> T; where T and U are types.: While processing transform(number, [1], [NULL]). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46772) (comment: 02542_transform_old.sql) (in query: SELECT transform(number, [1], [null]) FROM system.numbers LIMIT 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3b0561 in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:28:21.166711 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:21.179904 [ 3139 ] {a02762c8-46b2-414a-a459-3e47cc6921e4} <Error> TCPHandler: Code: 43. DB::Exception: Function transform has signature: transform(T, Array(T), Array(U), U) -> U; or transform(T, Array(T), Array(T)) -> T; where T and U are types.: While processing transform(number, [1], [NULL]). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3b0561 in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:28:22.179609 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:23.185023 [ 2441 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:25.975678 [ 2407 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:25.975670 [ 3991 ] {282bd6cf-1ae1-4cbd-8832-2153f2fe0b04} <Error> executeQuery: Code: 60. DB::Exception: Table test_01192.rmt does not exist. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46944) (comment: 01192_rename_database_zookeeper.sh) (in query: SELECT count(n), sum(n) FROM test_01192_atomic.mv), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/StorageMaterializedView.cpp:409: DB::StorageMaterializedView::getTargetTable() const @ 0x000000003bde37a7 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageMaterializedView.cpp:420: DB::StorageMaterializedView::getVirtuals() const @ 0x000000003bdef642 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:621: DB::StorageSnapshot::init() @ 0x000000003c4a4d6c in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/StorageSnapshot.h:0: DB::StorageSnapshot::StorageSnapshot(DB::IStorage const&, std::shared_ptr<DB::StorageInMemoryMetadata const>) @ 0x0000000034ab823b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageSnapshot> std::allocate_shared[abi:v15000]<DB::StorageSnapshot, std::allocator<DB::StorageSnapshot>, DB::IStorage const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, void>(std::allocator<DB::StorageSnapshot> const&, DB::IStorage const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x0000000034ab7e68 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/IStorage.h:0: DB::IStorage::getStorageSnapshot(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) const @ 0x0000000034ab7017 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/IStorage.h:0: DB::IStorage::getStorageSnapshotForQuery(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x0000000034ab72ca in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b232bc in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:26.037472 [ 3991 ] {282bd6cf-1ae1-4cbd-8832-2153f2fe0b04} <Error> TCPHandler: Code: 60. DB::Exception: Table test_01192.rmt does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/StorageMaterializedView.cpp:409: DB::StorageMaterializedView::getTargetTable() const @ 0x000000003bde37a7 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageMaterializedView.cpp:420: DB::StorageMaterializedView::getVirtuals() const @ 0x000000003bdef642 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:621: DB::StorageSnapshot::init() @ 0x000000003c4a4d6c in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/StorageSnapshot.h:0: DB::StorageSnapshot::StorageSnapshot(DB::IStorage const&, std::shared_ptr<DB::StorageInMemoryMetadata const>) @ 0x0000000034ab823b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageSnapshot> std::allocate_shared[abi:v15000]<DB::StorageSnapshot, std::allocator<DB::StorageSnapshot>, DB::IStorage const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, void>(std::allocator<DB::StorageSnapshot> const&, DB::IStorage const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x0000000034ab7e68 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/IStorage.h:0: DB::IStorage::getStorageSnapshot(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) const @ 0x0000000034ab7017 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/IStorage.h:0: DB::IStorage::getStorageSnapshotForQuery(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x0000000034ab72ca in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b232bc in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:27.021846 [ 2436 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:28.024543 [ 2441 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:29.026539 [ 2460 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:30.029792 [ 2362 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:31.780554 [ 2751 ] {c7b0fea7-0b34-4bac-abd5-0c7731730664} <Error> executeQuery: Code: 48. DB::Exception: Ordinary: RENAME DATABASE is not supported. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:54326) (comment: 01192_rename_database_zookeeper.sh) (in query: RENAME DATABASE test_01192 TO test_01192_renamed), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.h:303: DB::IDatabase::renameDatabase(std::shared_ptr<DB::Context const>, String const&) @ 0x000000003707270e in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::executeToDatabase(DB::ASTRenameQuery const&, std::vector<DB::RenameDescription, std::allocator<DB::RenameDescription>> const&) @ 0x0000000039afaf93 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:73: DB::InterpreterRenameQuery::execute() @ 0x0000000039af6e61 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:31.781749 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:31.797000 [ 2751 ] {c7b0fea7-0b34-4bac-abd5-0c7731730664} <Error> TCPHandler: Code: 48. DB::Exception: Ordinary: RENAME DATABASE is not supported. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.h:303: DB::IDatabase::renameDatabase(std::shared_ptr<DB::Context const>, String const&) @ 0x000000003707270e in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::executeToDatabase(DB::ASTRenameQuery const&, std::vector<DB::RenameDescription, std::allocator<DB::RenameDescription>> const&) @ 0x0000000039afaf93 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:73: DB::InterpreterRenameQuery::execute() @ 0x0000000039af6e61 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:32.798360 [ 2385 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:33.802081 [ 2332 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:34.812295 [ 2343 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:35.826461 [ 2342 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:36.830177 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:37.835264 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:38.840916 [ 2392 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:41.037467 [ 6638 ] {a51b33f8-95eb-4b56-98c1-ace2817d209f} <Warning> DatabaseReplicated (test_1gaeiuxd): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments
2024.09.24 02:28:42.177968 [ 3232 ] {cf9c461d-6c51-4d31-98ae-7d680b6e060f} <Warning> test_rhy6tku0.table_one (c2b952e6-5e51-4c7c-a12c-ccf8025f5d43): Table can't create parts with adaptive granularity, but settings min_rows_for_wide_part = 0, min_bytes_for_wide_part = 100. Parts with non-adaptive granularity can be stored only in Wide (default) format. Settings 'min_rows_for_wide_part'and 'min_bytes_for_wide_part' will be ignored.
2024.09.24 02:28:42.280643 [ 6638 ] {a51b33f8-95eb-4b56-98c1-ace2817d209f} <Error> executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50612) (comment: 00926_zookeeper_adaptive_index_granularity_replicated_merge_tree_long.sql) (in query: CREATE TABLE zero_rows_per_granule1 ( p Date, k UInt64, v1 UInt64, v2 Int64 ) ENGINE ReplicatedMergeTree('/clickhouse/tables/{database}/test_00926/zero_rows_in_granule', '1') PARTITION BY toYYYYMM(p) ORDER BY k SETTINGS index_granularity_bytes = 20, min_index_granularity_bytes = 10, write_final_mark = 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:42.281116 [ 2424 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:42.284072 [ 6638 ] {a51b33f8-95eb-4b56-98c1-ace2817d209f} <Error> TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:42.287553 [ 6601 ] {c4776115-5bb2-4bd1-8b80-6a5f46374cc8} <Error> executeQuery: Code: 36. DB::Exception: Cannot replace partition '201403' because part '201403_1_7_1' has inconsistent granularity with table. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 00152_insert_different_granularity.sql) (in query: /* ddl_entry=query-0000000017 */ ALTER TABLE test_11.fixed_granularity_table REPLACE PARTITION 201403 FROM test.hits), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String const&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String const&>::type>, String&, String const&) @ 0x0000000020b56f35 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da7db31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<DB::PartitionCommand, std::allocator<DB::PartitionCommand>> const&, std::shared_ptr<DB::Context const>) @ 0x000000003cf38e8c in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fa088 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
11. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
12. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f591d in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:42.539230 [ 6601 ] {c4776115-5bb2-4bd1-8b80-6a5f46374cc8} <Error> executeQuery: Code: 36. DB::Exception: Cannot replace partition '201403' because part '201403_1_7_1' has inconsistent granularity with table. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50568) (comment: 00152_insert_different_granularity.sql) (in query: ALTER TABLE fixed_granularity_table REPLACE PARTITION 201403 FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String const&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String const&>::type>, String&, String const&) @ 0x0000000020b56f35 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da7db31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<DB::PartitionCommand, std::allocator<DB::PartitionCommand>> const&, std::shared_ptr<DB::Context const>) @ 0x000000003cf38e8c in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fa088 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
11. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
12. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f591d in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:42.557357 [ 6601 ] {c4776115-5bb2-4bd1-8b80-6a5f46374cc8} <Error> TCPHandler: Code: 36. DB::Exception: Cannot replace partition '201403' because part '201403_1_7_1' has inconsistent granularity with table. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String const&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String const&>::type>, String&, String const&) @ 0x0000000020b56f35 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da7db31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<DB::PartitionCommand, std::allocator<DB::PartitionCommand>> const&, std::shared_ptr<DB::Context const>) @ 0x000000003cf38e8c in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fa088 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
11. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
12. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f591d in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:42.657372 [ 3232 ] {baee8255-fdca-4661-9ee8-cf18633599d5} <Warning> test_rhy6tku0.table_two (82a15fc5-539d-406b-93fd-03784445ba7b): Table can't create parts with adaptive granularity, but settings min_rows_for_wide_part = 0, min_bytes_for_wide_part = 100. Parts with non-adaptive granularity can be stored only in Wide (default) format. Settings 'min_rows_for_wide_part'and 'min_bytes_for_wide_part' will be ignored.
2024.09.24 02:28:43.291091 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:45.620096 [ 3980 ] {cb78f99d-9876-40d2-a7e3-003de7729a84} <Error> executeQuery: Code: 59. DB::Exception: Illegal type Float64 of column modulo(sipHash64(sipHash64(p, toString(toDate(p))), toString(toDate(p))), -0.) for filter. Must be UInt8 or Nullable(UInt8). (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50626) (comment: 02680_illegal_type_of_filter_projection.sql) (in query: SELECT count() FROM test_tuple PREWHERE sipHash64(sipHash64(p, toString(toDate(p))), toString(toDate(p))) % -0. WHERE i > NULL settings optimize_trivial_count_query=0, optimize_use_implicit_projections=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:91: DB::QueryPlanOptimizations::findInOutputs(DB::ActionsDAG&, String const&, bool) @ 0x000000003f3d0fc1 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:134: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d17c5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:147: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d197f in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:147: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d197f in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:0: DB::QueryPlanOptimizations::QueryDAG::build(DB::QueryPlan::Node&) @ 0x000000003f3d2130 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeUseAggregateProjection.cpp:460: DB::QueryPlanOptimizations::getAggregateProjectionCandidates(DB::QueryPlan::Node&, DB::AggregatingStep&, DB::ReadFromMergeTree&, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>> const&, bool) @ 0x000000003f3adfb6 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeUseAggregateProjection.cpp:0: DB::QueryPlanOptimizations::optimizeUseAggregateProjections(DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&, bool) @ 0x000000003f3b4467 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:135: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31d2d4 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:45.624352 [ 2439 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:45.993857 [ 6601 ] {026d24b9-23d3-4a2e-b4bc-f5c198b11e26} <Warning> DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments
2024.09.24 02:28:46.334850 [ 3980 ] {cb78f99d-9876-40d2-a7e3-003de7729a84} <Error> TCPHandler: Code: 59. DB::Exception: Illegal type Float64 of column modulo(sipHash64(sipHash64(p, toString(toDate(p))), toString(toDate(p))), -0.) for filter. Must be UInt8 or Nullable(UInt8). (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:91: DB::QueryPlanOptimizations::findInOutputs(DB::ActionsDAG&, String const&, bool) @ 0x000000003f3d0fc1 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:134: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d17c5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:147: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d197f in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:147: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d197f in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:0: DB::QueryPlanOptimizations::QueryDAG::build(DB::QueryPlan::Node&) @ 0x000000003f3d2130 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeUseAggregateProjection.cpp:460: DB::QueryPlanOptimizations::getAggregateProjectionCandidates(DB::QueryPlan::Node&, DB::AggregatingStep&, DB::ReadFromMergeTree&, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>> const&, bool) @ 0x000000003f3adfb6 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeUseAggregateProjection.cpp:0: DB::QueryPlanOptimizations::optimizeUseAggregateProjections(DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&, bool) @ 0x000000003f3b4467 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:135: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31d2d4 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:46.335093 [ 6601 ] {026d24b9-23d3-4a2e-b4bc-f5c198b11e26} <Error> executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41226) (comment: 02124_insert_deduplication_token_materialized_views.sql) (in query: CREATE TABLE test (`test` String, `A` Int64, `B` Int64) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{database}/test_02124/{table}', '1') ORDER BY tuple() SETTINGS index_granularity = 25915, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 4836, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 202857, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 3405842, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 54455, primary_key_compress_block_size = 43962), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:46.339187 [ 6601 ] {026d24b9-23d3-4a2e-b4bc-f5c198b11e26} <Error> TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:46.357427 [ 6597 ] {16dd79c6-a5ba-4e25-bc32-2cc06f392751} <Error> executeQuery: Code: 584. DB::Exception: No projection is used when optimize_use_projections = 1 and force_optimize_projection = 1. (PROJECTION_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50632) (comment: 01710_projections.sql) (in query: select * from projection_test;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [90]>(int, char const (&) [90]) @ 0x000000000f03ff17 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:0: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31dc50 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:46.362049 [ 6597 ] {16dd79c6-a5ba-4e25-bc32-2cc06f392751} <Error> TCPHandler: Code: 584. DB::Exception: No projection is used when optimize_use_projections = 1 and force_optimize_projection = 1. (PROJECTION_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [90]>(int, char const (&) [90]) @ 0x000000000f03ff17 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:0: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31dc50 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:47.601656 [ 6597 ] {cc0bf4c6-0eda-4021-a1f1-7951290118b7} <Error> executeQuery: Code: 403. DB::Exception: Illegal expression '1' in JOIN ON section: While processing 1. (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50632) (comment: 01710_projections.sql) (in query: select toStartOfMinute(datetime) dt_m, countIf(first_time = 0) from projection_test join (select 1) x on 1 where domain = '1' group by dt_m order by dt_m;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:76: DB::InDepthNodeVisitor<DB::CollectJoinOnKeysMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x000000003a731abc in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a700092 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:47.605216 [ 2365 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:48.964024 [ 3101 ] {c4912a45-3e51-4050-8475-3da2e4d135fb} <Warning> DatabaseReplicated (test_59icvj03): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments
2024.09.24 02:28:49.083074 [ 6597 ] {cc0bf4c6-0eda-4021-a1f1-7951290118b7} <Error> TCPHandler: Code: 403. DB::Exception: Illegal expression '1' in JOIN ON section: While processing 1. (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:76: DB::InDepthNodeVisitor<DB::CollectJoinOnKeysMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x000000003a731abc in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a700092 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:49.121275 [ 6601 ] {3c008bec-e676-4c34-9bb8-ede17ad0555d} <Error> executeQuery: Code: 36. DB::Exception: Columns: a listed both in columns to sum and in partition key. That is not allowed. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01373_summing_merge_tree_explicit_columns_definition.sql) (in query: /* ddl_entry=query-0000000033 */ CREATE TABLE test_5.tt_error_1373 UUID '590049c2-48b9-4bc8-b8bb-735009db573f' (`a` Int64, `d` Int64, `val` Int64) ENGINE = SummingMergeTree((a, val)) PARTITION BY a ORDER BY d SETTINGS index_granularity = 57032, min_bytes_for_wide_part = 673356905, ratio_of_defaults_for_sparse_serialization = 0.1563464105129242, merge_max_block_size = 24317, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 5134499821, index_granularity_bytes = 4757363, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 48997, primary_key_compress_block_size = 19342), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:927: DB::MergeTreeData::MergingParams::check(DB::StorageInMemoryMetadata const&) const @ 0x000000003ce4499f in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, bool, std::function<void (String const&)>) @ 0x000000003ce3ed48 in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da1661b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
17. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
18. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
23. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:50.814235 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:50.814298 [ 3139 ] {85f0e60e-6ace-4e20-8526-1189c9863c2c} <Error> executeQuery: Code: 636. DB::Exception: Cannot extract table structure from Parquet format file, because there are no files with provided path in S3 or all files are empty. You must specify table structure manually: Cannot extract table structure from Parquet format file. You can specify the structure manually. (CANNOT_EXTRACT_TABLE_STRUCTURE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41256) (comment: 02481_s3_throw_if_mismatch_files.sql) (in query: select a, b from s3(s3_conn, filename='test_02481_mismatch_filesxxx*', format=Parquet);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageS3.cpp:1489: DB::(anonymous namespace)::ReadBufferIterator::next() @ 0x000000003c3512d2 in /usr/bin/clickhouse
4. ./build_docker/./src/Formats/ReadSchemaUtils.cpp:85: DB::readSchemaFromFormat(String const&, std::optional<DB::FormatSettings> const&, DB::IReadBufferIterator&, bool, std::shared_ptr<DB::Context const>&, std::unique_ptr<DB::ReadBuffer, std::default_delete<DB::ReadBuffer>>&) @ 0x000000003e17b822 in /usr/bin/clickhouse
5. ./build_docker/./src/Formats/ReadSchemaUtils.cpp:0: DB::readSchemaFromFormat(String const&, std::optional<DB::FormatSettings> const&, DB::IReadBufferIterator&, bool, std::shared_ptr<DB::Context const>&) @ 0x000000003e182017 in /usr/bin/clickhouse
6. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::StorageS3::getTableStructureFromDataImpl(DB::StorageS3::Configuration const&, std::optional<DB::FormatSettings> const&, std::shared_ptr<DB::Context const>) @ 0x000000003c3347e5 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3::StorageS3(DB::StorageS3::Configuration const&, std::shared_ptr<DB::Context const>, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, std::optional<DB::FormatSettings>, bool, std::shared_ptr<DB::IAST>) @ 0x000000003c332149 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: void std::allocator_traits<std::allocator<DB::StorageS3>>::construct[abi:v15000]<DB::StorageS3, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void, void>(std::allocator<DB::StorageS3>&, DB::StorageS3*, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x0000000034a9b8af in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::StorageS3> std::allocate_shared[abi:v15000]<DB::StorageS3, std::allocator<DB::StorageS3>, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void>(std::allocator<DB::StorageS3> const&, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x0000000034a9b529 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionS3::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x0000000034a8897e in /usr/bin/clickhouse
11. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:50.814837 [ 3101 ] {c4912a45-3e51-4050-8475-3da2e4d135fb} <Error> executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41362) (comment: 00215_primary_key_order_zookeeper_long.sql) (in query: CREATE TABLE primary_key (d Date DEFAULT today(), x Int8) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{database}/test_00215/primary_key', 'r1', d, -x, 1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:51.531682 [ 6601 ] {3c008bec-e676-4c34-9bb8-ede17ad0555d} <Error> executeQuery: Code: 36. DB::Exception: Columns: a listed both in columns to sum and in partition key. That is not allowed. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41292) (comment: 01373_summing_merge_tree_explicit_columns_definition.sql) (in query: CREATE TABLE tt_error_1373 (`a` Int64, `d` Int64, `val` Int64) ENGINE = SummingMergeTree((a, val)) PARTITION BY a ORDER BY d SETTINGS index_granularity = 57032, min_bytes_for_wide_part = 673356905, ratio_of_defaults_for_sparse_serialization = 0.1563464105129242, merge_max_block_size = 24317, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 5134499821, index_granularity_bytes = 4757363, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 48997, primary_key_compress_block_size = 19342), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:927: DB::MergeTreeData::MergingParams::check(DB::StorageInMemoryMetadata const&) const @ 0x000000003ce4499f in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, bool, std::function<void (String const&)>) @ 0x000000003ce3ed48 in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da1661b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
17. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
18. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
23. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:51.766741 [ 3983 ] {02450_kill_distributed_query_deadlock_test_1-1} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41328) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:52.918899 [ 3139 ] {85f0e60e-6ace-4e20-8526-1189c9863c2c} <Error> TCPHandler: Code: 636. DB::Exception: Cannot extract table structure from Parquet format file, because there are no files with provided path in S3 or all files are empty. You must specify table structure manually: Cannot extract table structure from Parquet format file. You can specify the structure manually. (CANNOT_EXTRACT_TABLE_STRUCTURE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageS3.cpp:1489: DB::(anonymous namespace)::ReadBufferIterator::next() @ 0x000000003c3512d2 in /usr/bin/clickhouse
4. ./build_docker/./src/Formats/ReadSchemaUtils.cpp:85: DB::readSchemaFromFormat(String const&, std::optional<DB::FormatSettings> const&, DB::IReadBufferIterator&, bool, std::shared_ptr<DB::Context const>&, std::unique_ptr<DB::ReadBuffer, std::default_delete<DB::ReadBuffer>>&) @ 0x000000003e17b822 in /usr/bin/clickhouse
5. ./build_docker/./src/Formats/ReadSchemaUtils.cpp:0: DB::readSchemaFromFormat(String const&, std::optional<DB::FormatSettings> const&, DB::IReadBufferIterator&, bool, std::shared_ptr<DB::Context const>&) @ 0x000000003e182017 in /usr/bin/clickhouse
6. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::StorageS3::getTableStructureFromDataImpl(DB::StorageS3::Configuration const&, std::optional<DB::FormatSettings> const&, std::shared_ptr<DB::Context const>) @ 0x000000003c3347e5 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3::StorageS3(DB::StorageS3::Configuration const&, std::shared_ptr<DB::Context const>, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, std::optional<DB::FormatSettings>, bool, std::shared_ptr<DB::IAST>) @ 0x000000003c332149 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: void std::allocator_traits<std::allocator<DB::StorageS3>>::construct[abi:v15000]<DB::StorageS3, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void, void>(std::allocator<DB::StorageS3>&, DB::StorageS3*, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x0000000034a9b8af in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::StorageS3> std::allocate_shared[abi:v15000]<DB::StorageS3, std::allocator<DB::StorageS3>, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void>(std::allocator<DB::StorageS3> const&, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x0000000034a9b529 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionS3::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x0000000034a8897e in /usr/bin/clickhouse
11. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:52.918915 [ 3101 ] {c4912a45-3e51-4050-8475-3da2e4d135fb} <Error> TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:52.919023 [ 3983 ] {02450_kill_distributed_query_deadlock_test_1-1} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:52.919007 [ 3981 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:55424). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000020a094ce in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a581e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:52.919158 [ 3107 ] {48868465-c443-4af7-a788-7ba5de0e85dd} <Error> executeQuery: Code: 191. DB::Exception: Limit for JOIN exceeded, max rows: 1.00 thousand, current rows: 1.04 thousand: While executing FillingRightJoinSide. (SET_SIZE_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41232) (comment: 00063_loyalty_joins.sql) (in query: SELECT loyalty, count() FROM test.hits ANY LEFT JOIN ( SELECT UserID, sum(SearchEngineID = 2) AS yandex, sum(SearchEngineID = 3) AS google, toInt8(if(yandex > google, yandex / (yandex + google), -google / (yandex + google)) * 10) AS loyalty FROM test.hits WHERE (SearchEngineID = 2) OR (SearchEngineID = 3) GROUP BY UserID HAVING (yandex + google) > 10 ) USING UserID GROUP BY loyalty ORDER BY loyalty ASC;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/HashJoin.cpp:0: DB::HashJoin::addBlockToJoin(DB::Block const&, bool) @ 0x0000000038d6292b in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/JoiningTransform.cpp:307: DB::FillingRightJoinSideTransform::work() @ 0x000000003ebc86cd in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:52.922429 [ 6638 ] {4a99d0fd-1ee1-43a3-8676-75a25b16b158} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 417.57 MiB (attempt to allocate chunk of 1278048 bytes), maximum: 9.31 GiB: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35554) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format CSV ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
8. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
9. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:52.924579 [ 6601 ] {3c008bec-e676-4c34-9bb8-ede17ad0555d} <Error> TCPHandler: Code: 36. DB::Exception: Columns: a listed both in columns to sum and in partition key. That is not allowed. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:927: DB::MergeTreeData::MergingParams::check(DB::StorageInMemoryMetadata const&) const @ 0x000000003ce4499f in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, bool, std::function<void (String const&)>) @ 0x000000003ce3ed48 in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da1661b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
17. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
18. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
23. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:52.926414 [ 4381 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:44614). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:52.928554 [ 2751 ] {cdaa84e3-54e9-4d32-8928-63030c34811f} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 161.53 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41424) (comment: 00139_like.sql) (in query: /* Note that queries are written as the user doesn't really understand that the symbol _ has special meaning in LIKE pattern. */
 SELECT count() FROM test.hits WHERE URL LIKE '%/avtomobili_s_probegom/_%__%__%__%';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:52.932374 [ 2458 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:53.297981 [ 3107 ] {48868465-c443-4af7-a788-7ba5de0e85dd} <Error> TCPHandler: Code: 191. DB::Exception: Limit for JOIN exceeded, max rows: 1.00 thousand, current rows: 1.04 thousand: While executing FillingRightJoinSide. (SET_SIZE_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/HashJoin.cpp:0: DB::HashJoin::addBlockToJoin(DB::Block const&, bool) @ 0x0000000038d6292b in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Transforms/JoiningTransform.cpp:307: DB::FillingRightJoinSideTransform::work() @ 0x000000003ebc86cd in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:53.622064 [ 6601 ] {02450_kill_distributed_query_deadlock_test_1-2} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41464) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:53.631153 [ 6601 ] {02450_kill_distributed_query_deadlock_test_1-2} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:55.267312 [ 3139 ] {77e515ff-a96a-4a46-af1b-1f9fb40d4647} <Error> executeQuery: Code: 107. DB::Exception: Can not match any files using prefix test_02481_mismatch_filesxxx. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41256) (comment: 02481_s3_throw_if_mismatch_files.sql) (in query: select a, b from s3(s3_conn, filename='test_02481_mismatch_filesxxx*', format=Parquet) settings s3_throw_on_zero_files_match=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageS3.cpp:257: DB::StorageS3Source::DisclosedGlobIterator::Impl::fillInternalBufferAssumeLocked() @ 0x000000003c36375f in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3Source::DisclosedGlobIterator::Impl::Impl(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>) @ 0x000000003c3782b3 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::StorageS3Source::DisclosedGlobIterator::Impl* std::construct_at[abi:v15000]<DB::StorageS3Source::DisclosedGlobIterator::Impl, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&, DB::StorageS3Source::DisclosedGlobIterator::Impl*>(DB::StorageS3Source::DisclosedGlobIterator::Impl*, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&) @ 0x000000003c376580 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::StorageS3Source::DisclosedGlobIterator::Impl> std::make_shared[abi:v15000]<DB::StorageS3Source::DisclosedGlobIterator::Impl, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&, void>(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&) @ 0x000000003c357390 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageS3.cpp:363: DB::StorageS3Source::DisclosedGlobIterator::DisclosedGlobIterator(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>) @ 0x000000003c31e394 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::StorageS3Source::DisclosedGlobIterator* std::construct_at[abi:v15000]<DB::StorageS3Source::DisclosedGlobIterator, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&, DB::StorageS3Source::DisclosedGlobIterator*>(DB::StorageS3Source::DisclosedGlobIterator*, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&) @ 0x000000003c391478 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::StorageS3Source::DisclosedGlobIterator> std::make_shared[abi:v15000]<DB::StorageS3Source::DisclosedGlobIterator, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&, void>(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&) @ 0x000000003c35cf90 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/StorageS3.cpp:1026: DB::StorageS3::createFileIterator(DB::StorageS3::Configuration const&, bool, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST>, DB::NamesAndTypesList const&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*, std::function<void (DB::FileProgress)>) @ 0x000000003c336068 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageS3.cpp:1555: DB::StorageS3::getTableStructureFromDataImpl(DB::StorageS3::Configuration const&, std::optional<DB::FormatSettings> const&, std::shared_ptr<DB::Context const>) @ 0x000000003c333594 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3::StorageS3(DB::StorageS3::Configuration const&, std::shared_ptr<DB::Context const>, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, std::optional<DB::FormatSettings>, bool, std::shared_ptr<DB::IAST>) @ 0x000000003c332149 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: void std::allocator_traits<std::allocator<DB::StorageS3>>::construct[abi:v15000]<DB::StorageS3, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void, void>(std::allocator<DB::StorageS3>&, DB::StorageS3*, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x0000000034a9b8af in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::StorageS3> std::allocate_shared[abi:v15000]<DB::StorageS3, std::allocator<DB::StorageS3>, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void>(std::allocator<DB::StorageS3> const&, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x0000000034a9b529 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionS3::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x0000000034a8897e in /usr/bin/clickhouse
16. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse

2024.09.24 02:28:55.915985 [ 3154 ] {af47f6a6-f214-4f32-bbaa-5928e32c0b5c} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55428). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:55428) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:55.915995 [ 2751 ] {cdaa84e3-54e9-4d32-8928-63030c34811f} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 161.53 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:55.916094 [ 3139 ] {77e515ff-a96a-4a46-af1b-1f9fb40d4647} <Error> TCPHandler: Code: 107. DB::Exception: Can not match any files using prefix test_02481_mismatch_filesxxx. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageS3.cpp:257: DB::StorageS3Source::DisclosedGlobIterator::Impl::fillInternalBufferAssumeLocked() @ 0x000000003c36375f in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3Source::DisclosedGlobIterator::Impl::Impl(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>) @ 0x000000003c3782b3 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::StorageS3Source::DisclosedGlobIterator::Impl* std::construct_at[abi:v15000]<DB::StorageS3Source::DisclosedGlobIterator::Impl, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&, DB::StorageS3Source::DisclosedGlobIterator::Impl*>(DB::StorageS3Source::DisclosedGlobIterator::Impl*, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&) @ 0x000000003c376580 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::StorageS3Source::DisclosedGlobIterator::Impl> std::make_shared[abi:v15000]<DB::StorageS3Source::DisclosedGlobIterator::Impl, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&, void>(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&) @ 0x000000003c357390 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageS3.cpp:363: DB::StorageS3Source::DisclosedGlobIterator::DisclosedGlobIterator(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>) @ 0x000000003c31e394 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::StorageS3Source::DisclosedGlobIterator* std::construct_at[abi:v15000]<DB::StorageS3Source::DisclosedGlobIterator, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&, DB::StorageS3Source::DisclosedGlobIterator*>(DB::StorageS3Source::DisclosedGlobIterator*, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&) @ 0x000000003c391478 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::StorageS3Source::DisclosedGlobIterator> std::make_shared[abi:v15000]<DB::StorageS3Source::DisclosedGlobIterator, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&, void>(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*&, DB::S3Settings::RequestSettings const&, std::function<void (DB::FileProgress)>&) @ 0x000000003c35cf90 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/StorageS3.cpp:1026: DB::StorageS3::createFileIterator(DB::StorageS3::Configuration const&, bool, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST>, DB::NamesAndTypesList const&, std::vector<DB::StorageS3Source::KeyWithInfo, std::allocator<DB::StorageS3Source::KeyWithInfo>>*, std::function<void (DB::FileProgress)>) @ 0x000000003c336068 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageS3.cpp:1555: DB::StorageS3::getTableStructureFromDataImpl(DB::StorageS3::Configuration const&, std::optional<DB::FormatSettings> const&, std::shared_ptr<DB::Context const>) @ 0x000000003c333594 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3::StorageS3(DB::StorageS3::Configuration const&, std::shared_ptr<DB::Context const>, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, std::optional<DB::FormatSettings>, bool, std::shared_ptr<DB::IAST>) @ 0x000000003c332149 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: void std::allocator_traits<std::allocator<DB::StorageS3>>::construct[abi:v15000]<DB::StorageS3, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void, void>(std::allocator<DB::StorageS3>&, DB::StorageS3*, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x0000000034a9b8af in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::StorageS3> std::allocate_shared[abi:v15000]<DB::StorageS3, std::allocator<DB::StorageS3>, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void>(std::allocator<DB::StorageS3> const&, DB::StorageS3::Configuration&, std::shared_ptr<DB::Context const>&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x0000000034a9b529 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionS3::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x0000000034a8897e in /usr/bin/clickhouse
16. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse

2024.09.24 02:28:55.916168 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-3} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41552) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:55.921281 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:55.945636 [ 3154 ] {af47f6a6-f214-4f32-bbaa-5928e32c0b5c} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55428). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:55.945972 [ 3154 ] {af47f6a6-f214-4f32-bbaa-5928e32c0b5c} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55428). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:56.007631 [ 3154 ] {af47f6a6-f214-4f32-bbaa-5928e32c0b5c} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:28:56.020672 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-3} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:56.738331 [ 2950 ] {3d0b8435-32fd-4c2a-8417-a2de066c6e12} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:45642). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:45642) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:56.807176 [ 2950 ] {3d0b8435-32fd-4c2a-8417-a2de066c6e12} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:45642). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:56.807480 [ 2950 ] {3d0b8435-32fd-4c2a-8417-a2de066c6e12} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:45642). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:56.852485 [ 2950 ] {3d0b8435-32fd-4c2a-8417-a2de066c6e12} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:28:56.951682 [ 2396 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:58.607679 [ 6638 ] {4a99d0fd-1ee1-43a3-8676-75a25b16b158} <Error> DynamicQueryHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 417.57 MiB (attempt to allocate chunk of 1278048 bytes), maximum: 9.31 GiB: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
8. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
9. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:58.607730 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-4} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36148) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:58.610850 [ 3101 ] {078f7bc4-29c9-4c22-9c30-bdba7dd76945} <Error> executeQuery: Code: 47. DB::Exception: Missing columns: '_shard_num' while processing query: 'SELECT _shard_num FROM system.one', required columns: '_shard_num'. (UNKNOWN_IDENTIFIER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41536) (comment: 02163_shard_num.sql) (in query: SELECT _shard_num FROM remote('127.1', system.one) AS a INNER JOIN (SELECT _shard_num FROM system.one) AS b USING (dummy);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a70088d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSelectWithUnionQuery::getSampleBlock(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool, bool) @ 0x0000000039d8ab20 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/getTableExpressions.cpp:90: DB::getDatabaseAndTablesWithColumns(std::vector<DB::ASTTableExpression const*, std::allocator<DB::ASTTableExpression const*>> const&, std::shared_ptr<DB::Context const>, bool, bool, bool) @ 0x000000003a9ec2b9 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/JoinedTables.cpp:243: DB::JoinedTables::resolveTables() @ 0x0000000039e6c04d in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:448: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b23521 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:58.623179 [ 3101 ] {078f7bc4-29c9-4c22-9c30-bdba7dd76945} <Error> TCPHandler: Code: 47. DB::Exception: Missing columns: '_shard_num' while processing query: 'SELECT _shard_num FROM system.one', required columns: '_shard_num'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a70088d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSelectWithUnionQuery::getSampleBlock(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool, bool) @ 0x0000000039d8ab20 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/getTableExpressions.cpp:90: DB::getDatabaseAndTablesWithColumns(std::vector<DB::ASTTableExpression const*, std::allocator<DB::ASTTableExpression const*>> const&, std::shared_ptr<DB::Context const>, bool, bool, bool) @ 0x000000003a9ec2b9 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/JoinedTables.cpp:243: DB::JoinedTables::resolveTables() @ 0x0000000039e6c04d in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:448: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b23521 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:58.621250 [ 2333 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:28:58.659128 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-4} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:28:58.727969 [ 3976 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:43582). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:01.082305 [ 3992 ] {02450_kill_distributed_query_deadlock_test_1-5} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36202) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:01.085332 [ 3154 ] {9a22544a-cee1-4c4c-9e76-781f0acd4392} <Error> executeQuery: Code: 43. DB::Exception: Illegal types Float64 and UInt64 of arguments of function least: While processing least(-1., 18446744073709551615). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36152) (comment: 01246_least_greatest_generic.sql) (in query: -- This can be improved
 SELECT LEAST(-1., 18446744073709551615);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000947c83e in /usr/bin/clickhouse
3. DB::FunctionBinaryArithmetic<DB::LeastImpl, DB::NameLeast, true, true, false>::getReturnTypeImplStatic(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, std::shared_ptr<DB::Context const>) @ 0x0000000015afee38 in /usr/bin/clickhouse
4. DB::FunctionBinaryArithmetic<DB::LeastImpl, DB::NameLeast, true, true, false>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x0000000015444143 in /usr/bin/clickhouse
5. DB::LeastGreatestOverloadResolver<(DB::LeastGreatest)0, DB::FunctionBinaryArithmetic<DB::LeastImpl, DB::NameLeast, true, true, false>>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x0000000015442006 in /usr/bin/clickhouse
6. DB::IFunctionOverloadResolver::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000bea2993 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:29:01.085479 [ 2354 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:01.731321 [ 3992 ] {02450_kill_distributed_query_deadlock_test_1-5} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:01.731380 [ 6637 ] {e07bdc6b-186d-4c6c-ad6f-56d0ade6922c} <Error> executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36216) (in query: select _path,_file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:01.731408 [ 3182 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:43596). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:01.731408 [ 3154 ] {9a22544a-cee1-4c4c-9e76-781f0acd4392} <Error> TCPHandler: Code: 43. DB::Exception: Illegal types Float64 and UInt64 of arguments of function least: While processing least(-1., 18446744073709551615). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000947c83e in /usr/bin/clickhouse
3. DB::FunctionBinaryArithmetic<DB::LeastImpl, DB::NameLeast, true, true, false>::getReturnTypeImplStatic(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, std::shared_ptr<DB::Context const>) @ 0x0000000015afee38 in /usr/bin/clickhouse
4. DB::FunctionBinaryArithmetic<DB::LeastImpl, DB::NameLeast, true, true, false>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x0000000015444143 in /usr/bin/clickhouse
5. DB::LeastGreatestOverloadResolver<(DB::LeastGreatest)0, DB::FunctionBinaryArithmetic<DB::LeastImpl, DB::NameLeast, true, true, false>>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x0000000015442006 in /usr/bin/clickhouse
6. DB::IFunctionOverloadResolver::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000bea2993 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:29:01.736362 [ 6637 ] {e07bdc6b-186d-4c6c-ad6f-56d0ade6922c} <Error> TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:03.095756 [ 2424 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:03.095793 [ 3992 ] {5db246b1-9dee-4107-b26a-4f82e7ee1c80} <Error> executeQuery: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/format_schemas/nonexist, errno: 2, strerror: No such file or directory: While executing File. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36258) (in query: select * from file('test_02149_schema_inference_test_w4ri2lxc.data', 'Template', 'val1 char') settings format_template_row='nonexist'), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBufferFromFile.cpp:0: DB::ReadBufferFromFile::ReadBufferFromFile(String const&, unsigned long, int, char*, unsigned long, std::optional<unsigned long>, std::shared_ptr<DB::Throttler>) @ 0x00000000209a0358 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsedTemplateFormatString::ParsedTemplateFormatString(DB::FormatSchemaInfo const&, std::function<std::optional<unsigned long> (String const&)> const&, bool) @ 0x000000003ea75246 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Formats/Impl/TemplateRowInputFormat.cpp:0: DB::fillRowFormat(DB::FormatSettings const&, std::function<std::optional<unsigned long> (String const&)>, bool) @ 0x000000003ea8975b in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Formats/Impl/TemplateRowInputFormat.cpp:591: std::shared_ptr<DB::IInputFormat> std::__function::__policy_invoker<std::shared_ptr<DB::IInputFormat> (DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerInputFormatTemplate(DB::FormatFactory&)::$_0, std::shared_ptr<DB::IInputFormat> (DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&)>>(std::__function::__policy_storage const*, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&) @ 0x000000003ea8882c in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::FormatFactory::getInput(String const&, DB::ReadBuffer&, DB::Block const&, std::shared_ptr<DB::Context const>, unsigned long, std::optional<DB::FormatSettings> const&, std::optional<unsigned long>, std::optional<unsigned long>, bool, DB::CompressionMethod) const @ 0x000000003e122a15 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Context.cpp:3778: DB::Context::getInputFormat(String const&, DB::ReadBuffer&, DB::Block const&, unsigned long, std::optional<DB::FormatSettings> const&, std::optional<unsigned long>) const @ 0x00000000378f561c in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/StorageFile.cpp:0: DB::StorageFileSource::generate() @ 0x000000003bc65ddd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:04.266002 [ 2759 ] {602c2df3-f088-46a5-a65f-3743ffb995cc} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 371.31 MiB (attempt to allocate chunk of 1048704 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:41406) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format CSV ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:05.753451 [ 3992 ] {5db246b1-9dee-4107-b26a-4f82e7ee1c80} <Error> TCPHandler: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/format_schemas/nonexist, errno: 2, strerror: No such file or directory: While executing File. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBufferFromFile.cpp:0: DB::ReadBufferFromFile::ReadBufferFromFile(String const&, unsigned long, int, char*, unsigned long, std::optional<unsigned long>, std::shared_ptr<DB::Throttler>) @ 0x00000000209a0358 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsedTemplateFormatString::ParsedTemplateFormatString(DB::FormatSchemaInfo const&, std::function<std::optional<unsigned long> (String const&)> const&, bool) @ 0x000000003ea75246 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Formats/Impl/TemplateRowInputFormat.cpp:0: DB::fillRowFormat(DB::FormatSettings const&, std::function<std::optional<unsigned long> (String const&)>, bool) @ 0x000000003ea8975b in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Formats/Impl/TemplateRowInputFormat.cpp:591: std::shared_ptr<DB::IInputFormat> std::__function::__policy_invoker<std::shared_ptr<DB::IInputFormat> (DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerInputFormatTemplate(DB::FormatFactory&)::$_0, std::shared_ptr<DB::IInputFormat> (DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&)>>(std::__function::__policy_storage const*, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&) @ 0x000000003ea8882c in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::FormatFactory::getInput(String const&, DB::ReadBuffer&, DB::Block const&, std::shared_ptr<DB::Context const>, unsigned long, std::optional<DB::FormatSettings> const&, std::optional<unsigned long>, std::optional<unsigned long>, bool, DB::CompressionMethod) const @ 0x000000003e122a15 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Context.cpp:3778: DB::Context::getInputFormat(String const&, DB::ReadBuffer&, DB::Block const&, unsigned long, std::optional<DB::FormatSettings> const&, std::optional<unsigned long>) const @ 0x00000000378f561c in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/StorageFile.cpp:0: DB::StorageFileSource::generate() @ 0x000000003bc65ddd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:05.753533 [ 3154 ] {92b9a491-920f-481d-a9af-6ad0b03d5e09} <Error> executeQuery: Code: 42. DB::Exception: Function greatest cannot be called without arguments: While processing greatest(). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36152) (comment: 01246_least_greatest_generic.sql) (in query: SELECT Greatest();), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::LeastGreatestOverloadResolver<(DB::LeastGreatest)1, DB::FunctionBinaryArithmetic<DB::GreatestImpl, DB::NameGreatest, true, true, false>>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x0000000012e5553b in /usr/bin/clickhouse
4. DB::IFunctionOverloadResolver::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000bea2993 in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:29:07.445061 [ 3993 ] {fbed06b8-1971-42c5-a680-17dcd3b2a7ed} <Error> executeQuery: Code: 43. DB::Exception: 3-th argument for function 'splitByChar' must be integer, got 'String' instead: While processing splitByChar(',', '1,2,3', ''). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36182) (comment: 02475_split_with_max_substrings.sql) (in query: select splitByChar(',', '1,2,3', '');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByCharImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c42f84c in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:07.445162 [ 3154 ] {92b9a491-920f-481d-a9af-6ad0b03d5e09} <Error> TCPHandler: Code: 42. DB::Exception: Function greatest cannot be called without arguments: While processing greatest(). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::LeastGreatestOverloadResolver<(DB::LeastGreatest)1, DB::FunctionBinaryArithmetic<DB::GreatestImpl, DB::NameGreatest, true, true, false>>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x0000000012e5553b in /usr/bin/clickhouse
4. DB::IFunctionOverloadResolver::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000bea2993 in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:29:07.448662 [ 2422 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:07.452036 [ 3182 ] {02450_kill_distributed_query_deadlock_test_1-6} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36288) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:07.453997 [ 3991 ] {04334918-c3ff-4892-bd93-85e3a1ebd867} <Error> executeQuery: Code: 60. DB::Exception: Table test_fw1x0rwq.test_table_for_01070_exception_code_in_query_log_table does not exist. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47786) (comment: 01070_exception_code_in_query_log_table.sql) (in query: SELECT * FROM test_table_for_01070_exception_code_in_query_log_table;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:07.455475 [ 3993 ] {fbed06b8-1971-42c5-a680-17dcd3b2a7ed} <Error> TCPHandler: Code: 43. DB::Exception: 3-th argument for function 'splitByChar' must be integer, got 'String' instead: While processing splitByChar(',', '1,2,3', ''). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByCharImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c42f84c in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:07.464740 [ 3991 ] {04334918-c3ff-4892-bd93-85e3a1ebd867} <Error> TCPHandler: Code: 60. DB::Exception: Table test_fw1x0rwq.test_table_for_01070_exception_code_in_query_log_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:07.528662 [ 3182 ] {02450_kill_distributed_query_deadlock_test_1-6} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:07.537682 [ 6598 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:49736). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:09.149351 [ 2759 ] {602c2df3-f088-46a5-a65f-3743ffb995cc} <Error> DynamicQueryHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 371.31 MiB (attempt to allocate chunk of 1048704 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:09.149361 [ 3993 ] {befaba35-903e-469b-b2c7-16ff61bc1831} <Error> executeQuery: Code: 43. DB::Exception: 3-th argument for function 'splitByRegexp' must be integer, got 'String' instead: While processing splitByRegexp('[ABC]', 'oneAtwoBthreeC', ''). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36182) (comment: 02475_split_with_max_substrings.sql) (in query: select splitByRegexp('[ABC]', 'oneAtwoBthreeC', '');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByRegexpImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c43ec6c in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:09.151046 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:09.151036 [ 3182 ] {02450_kill_distributed_query_deadlock_test_1-7} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47806) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:09.154848 [ 3993 ] {befaba35-903e-469b-b2c7-16ff61bc1831} <Error> TCPHandler: Code: 43. DB::Exception: 3-th argument for function 'splitByRegexp' must be integer, got 'String' instead: While processing splitByRegexp('[ABC]', 'oneAtwoBthreeC', ''). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByRegexpImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c43ec6c in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:09.168485 [ 3182 ] {02450_kill_distributed_query_deadlock_test_1-7} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:09.179224 [ 6597 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:59114). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:11.007071 [ 3993 ] {ce91d1bc-5d75-4ff8-8b1a-8deff19e366e} <Error> executeQuery: Code: 43. DB::Exception: 2-th argument for function 'alphaTokens' must be integer, got 'String' instead: While processing alphaTokens('abca1abc', ''). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36182) (comment: 02475_split_with_max_substrings.sql) (in query: SELECT alphaTokens('abca1abc', '');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByAlphaImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c4199ac in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:11.562815 [ 3993 ] {ce91d1bc-5d75-4ff8-8b1a-8deff19e366e} <Error> TCPHandler: Code: 43. DB::Exception: 2-th argument for function 'alphaTokens' must be integer, got 'String' instead: While processing alphaTokens('abca1abc', ''). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByAlphaImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c4199ac in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:11.564216 [ 2381 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:11.565496 [ 6598 ] {02450_kill_distributed_query_deadlock_test_1-8} <Error> executeQuery: Code: 394. DB::Exception: Query '02450_kill_distributed_query_deadlock_test_1-8' is killed in pending state. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47836) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/executeQuery.cpp:1122: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a9272 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:11.606400 [ 6598 ] {02450_kill_distributed_query_deadlock_test_1-8} <Error> TCPHandler: Code: 394. DB::Exception: Query '02450_kill_distributed_query_deadlock_test_1-8' is killed in pending state. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/executeQuery.cpp:1122: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a9272 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:11.704981 [ 3993 ] {04921827-ff66-410c-bd9b-7aadc1abfa28} <Error> executeQuery: Code: 43. DB::Exception: 2-th argument for function 'alphaTokens' must be integer, got 'String' instead: While processing splitByAlpha('abca1abc', ''). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36182) (comment: 02475_split_with_max_substrings.sql) (in query: SELECT splitByAlpha('abca1abc', '');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByAlphaImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c4199ac in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:11.710073 [ 3993 ] {04921827-ff66-410c-bd9b-7aadc1abfa28} <Error> TCPHandler: Code: 43. DB::Exception: 2-th argument for function 'alphaTokens' must be integer, got 'String' instead: While processing splitByAlpha('abca1abc', ''). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByAlphaImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c4199ac in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:11.879385 [ 4381 ] {276e76db-a9f2-4177-b5e5-39cda3b46d72} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47898) (comment: 02381_join_dup_columns_in_plan.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:13.260977 [ 4381 ] {276e76db-a9f2-4177-b5e5-39cda3b46d72} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:13.277458 [ 2430 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:13.300477 [ 3993 ] {2acc8de3-3a1f-4357-ab0c-ebec6009e788} <Error> executeQuery: Code: 43. DB::Exception: 2-th argument for function 'splitByNonAlpha' must be integer, got 'String' instead: While processing splitByNonAlpha('  1!  a,  b.  ', ''). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36182) (comment: 02475_split_with_max_substrings.sql) (in query: SELECT splitByNonAlpha('  1!  a,  b.  ', '');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByNonAlphaImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c420eec in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:13.315039 [ 3993 ] {2acc8de3-3a1f-4357-ab0c-ebec6009e788} <Error> TCPHandler: Code: 43. DB::Exception: 2-th argument for function 'splitByNonAlpha' must be integer, got 'String' instead: While processing splitByNonAlpha('  1!  a,  b.  ', ''). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByNonAlphaImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c420eec in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:13.398530 [ 2751 ] {02450_kill_distributed_query_deadlock_test_1-9} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47936) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:13.422217 [ 2751 ] {02450_kill_distributed_query_deadlock_test_1-9} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:15.114593 [ 3107 ] {fb701f72-c7d8-4dd9-b3be-198c3d2e59df} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:60262). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60262) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:15.114768 [ 4381 ] {02450_kill_distributed_query_deadlock_test_1-10} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47984) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:15.117120 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:15.117615 [ 3993 ] {a9a7e7ad-323e-46fd-8010-22ef6f81bf84} <Error> executeQuery: Code: 43. DB::Exception: 2-th argument for function 'splitByWhitespace' must be integer, got 'String' instead: While processing splitByWhitespace('  1!  a,  b.  ', ''). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36182) (comment: 02475_split_with_max_substrings.sql) (in query: SELECT splitByWhitespace('  1!  a,  b.  ', '');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByWhitespaceImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c42834c in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:15.121652 [ 3993 ] {a9a7e7ad-323e-46fd-8010-22ef6f81bf84} <Error> TCPHandler: Code: 43. DB::Exception: 2-th argument for function 'splitByWhitespace' must be integer, got 'String' instead: While processing splitByWhitespace('  1!  a,  b.  ', ''). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByWhitespaceImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c42834c in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:15.127628 [ 4381 ] {02450_kill_distributed_query_deadlock_test_1-10} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:15.144780 [ 3107 ] {fb701f72-c7d8-4dd9-b3be-198c3d2e59df} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:60262). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:15.145049 [ 3107 ] {fb701f72-c7d8-4dd9-b3be-198c3d2e59df} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:60262). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:15.173923 [ 3107 ] {fb701f72-c7d8-4dd9-b3be-198c3d2e59df} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:15.180875 [ 2751 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:60272). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:16.932429 [ 2751 ] {02450_kill_distributed_query_deadlock_test_1-11} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38586) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:16.934279 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:16.934980 [ 3993 ] {f55cc7f0-dd1a-44ad-8a81-f6fea48c5725} <Error> executeQuery: Code: 43. DB::Exception: 3-th argument for function 'splitByString' must be integer, got 'String' instead: While processing splitByString(', ', '1, 2 3, 4,5, abcde', ''). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36182) (comment: 02475_split_with_max_substrings.sql) (in query: SELECT splitByString(', ', '1, 2 3, 4,5, abcde', '');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByStringImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c4372ac in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:16.947049 [ 3993 ] {f55cc7f0-dd1a-44ad-8a81-f6fea48c5725} <Error> TCPHandler: Code: 43. DB::Exception: 3-th argument for function 'splitByString' must be integer, got 'String' instead: While processing splitByString(', ', '1, 2 3, 4,5, abcde', ''). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long, String, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type>, unsigned long&&, String&&, String&&) @ 0x000000000c413c02 in /usr/bin/clickhouse
3. DB::FunctionTokens<DB::SplitByStringImpl>::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000000c4372ac in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:29:17.042076 [ 2751 ] {02450_kill_distributed_query_deadlock_test_1-11} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:17.087412 [ 3139 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:45024). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:17.948433 [ 2348 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:18.750148 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-12} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38664) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:18.787127 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-12} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:18.881577 [ 3154 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:46076). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:18.957540 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:19.991071 [ 2434 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:21.004560 [ 2425 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:21.082437 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-13} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38704) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:21.171501 [ 2751 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:38316). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:21.177528 [ 3101 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:60406). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000020a094ce in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a581e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:21.217308 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-13} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:21.304250 [ 3139 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:40492). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000020a094ce in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a581e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:22.009188 [ 2400 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:22.382298 [ 3139 ] {02450_kill_distributed_query_deadlock_test_1-14} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38752) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:22.409786 [ 3139 ] {02450_kill_distributed_query_deadlock_test_1-14} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:22.502833 [ 2860 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:45032). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:23.023476 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:23.428661 [ 3139 ] {02450_kill_distributed_query_deadlock_test_1-15} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38794) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:23.460673 [ 3139 ] {02450_kill_distributed_query_deadlock_test_1-15} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:23.564079 [ 3154 ] {616d8163-1deb-48c0-b661-9e795d587a01} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:46092). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:46092) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:23.613722 [ 3154 ] {616d8163-1deb-48c0-b661-9e795d587a01} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:46092). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:23.615349 [ 3154 ] {616d8163-1deb-48c0-b661-9e795d587a01} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:46092). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:23.646720 [ 3154 ] {616d8163-1deb-48c0-b661-9e795d587a01} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:24.027664 [ 2392 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:24.139105 [ 3983 ] {8058a01d-7703-45de-8689-3ca8f9c373b4} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 621.61 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38618) (comment: 00038_uniq_state_merge2.sql) (in query: SELECT topLevelDomain(concat('http://', k)) AS tld, sum(u) AS u, uniqMerge(us) AS us FROM (SELECT domain(URL) AS k, uniq(UserID) AS u, uniqState(UserID) AS us FROM test.hits GROUP BY k) GROUP BY tld ORDER BY u DESC, tld ASC LIMIT 100 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:24.471982 [ 3139 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:38322). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000020a094ce in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a581e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:25.031832 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:25.961249 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-16} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38838) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:26.038800 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:26.039589 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-16} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:26.094990 [ 3101 ] {3437d296-6e84-4dfa-9db0-b24206931d80} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59394). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59394) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:26.188357 [ 3101 ] {3437d296-6e84-4dfa-9db0-b24206931d80} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59394). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:26.188742 [ 3101 ] {3437d296-6e84-4dfa-9db0-b24206931d80} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59394). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:26.226677 [ 3101 ] {3437d296-6e84-4dfa-9db0-b24206931d80} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:27.099191 [ 2343 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:27.351998 [ 3101 ] {02450_kill_distributed_query_deadlock_test_1-17} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40986) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:27.370284 [ 3101 ] {02450_kill_distributed_query_deadlock_test_1-17} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:27.421061 [ 3994 ] {26d23a0f-d484-4867-ab07-e98d7f423692} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:35264). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35264) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:27.438621 [ 3994 ] {26d23a0f-d484-4867-ab07-e98d7f423692} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:35264). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:27.439026 [ 3994 ] {26d23a0f-d484-4867-ab07-e98d7f423692} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:35264). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:27.444164 [ 3994 ] {26d23a0f-d484-4867-ab07-e98d7f423692} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:28.103903 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:28.291763 [ 2950 ] {02450_kill_distributed_query_deadlock_test_1-18} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41052) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:28.312820 [ 2950 ] {02450_kill_distributed_query_deadlock_test_1-18} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:29.003339 [ 3994 ] {16afa897-923b-4c90-a1d7-d6a00cb9d2d6} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:33198). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33198) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:30.402872 [ 3983 ] {8058a01d-7703-45de-8689-3ca8f9c373b4} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 621.61 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:30.402940 [ 3994 ] {16afa897-923b-4c90-a1d7-d6a00cb9d2d6} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:33198). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:30.403005 [ 3101 ] {74bfef09-7307-4fa3-8c48-59d60241b0ba} <Error> executeQuery: Code: 352. DB::Exception: Block structure mismatch in (columns with identical name must have identical structure) stream: different columns:
c1 String String(size = 0)
c1 String Const(size = 0, String(size = 1)). (AMBIGUOUS_COLUMN_NAME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41026) (comment: 00864_union_all_supertype.sql) (in query: select * from ( select 'v1' as c1, null as c2 union all select 'v2' as c1, '' as c2 ) ALL FULL JOIN ( select 'v1' as c1, 'w1' as c2 ) using c1,c2 order by c1, c2;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&, String, String>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, std::basic_string_view<char, std::char_traits<char>>&, String&&, String&&) @ 0x00000000362b8900 in /usr/bin/clickhouse
3. ./build_docker/./src/Core/Block.cpp:38: void DB::onError<void, std::basic_string_view<char, std::char_traits<char>>&, String, String>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, std::basic_string_view<char, std::char_traits<char>>&, String&&, String&&) @ 0x00000000362aa1cf in /usr/bin/clickhouse
4. ./build_docker/./src/Core/Block.cpp:0: void DB::checkColumnStructure<void>(DB::ColumnWithTypeAndName const&, DB::ColumnWithTypeAndName const&, std::basic_string_view<char, std::char_traits<char>>, bool, int) @ 0x000000003629272f in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.cpp:0: DB::Block::insert(DB::ColumnWithTypeAndName) @ 0x0000000036293026 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::FullSortingMergeJoin::joinBlock(DB::Block&, std::shared_ptr<DB::ExtraBlock>&) @ 0x0000000037d12dc3 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/JoiningTransform.cpp:0: DB::JoiningTransform::transformHeader(DB::Block, std::shared_ptr<DB::IJoin> const&) @ 0x000000003ebb5709 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:29: DB::JoinStep::JoinStep(DB::DataStream const&, DB::DataStream const&, std::shared_ptr<DB::IJoin>, unsigned long, unsigned long, bool) @ 0x000000003f13c013 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b54989 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:30.407122 [ 2367 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:31.558248 [ 3994 ] {16afa897-923b-4c90-a1d7-d6a00cb9d2d6} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:33198). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:31.558305 [ 2950 ] {02450_kill_distributed_query_deadlock_test_1-19} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41074) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:437: DB::QueryStatus::addPipelineExecutor(DB::PipelineExecutor*) @ 0x0000000039fa267b in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::PipelineExecutor(std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>) @ 0x000000003e1fa172 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::PipelineExecutor> std::allocate_shared[abi:v15000]<DB::PipelineExecutor, std::allocator<DB::PipelineExecutor>, std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>&, void>(std::allocator<DB::PipelineExecutor> const&, std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>&) @ 0x0000000036a67d88 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000003e230e2f in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:153: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000003e232905 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:914: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c321c in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:31.558359 [ 3101 ] {74bfef09-7307-4fa3-8c48-59d60241b0ba} <Error> TCPHandler: Code: 352. DB::Exception: Block structure mismatch in (columns with identical name must have identical structure) stream: different columns:
c1 String String(size = 0)
c1 String Const(size = 0, String(size = 1)). (AMBIGUOUS_COLUMN_NAME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&, String, String>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, std::basic_string_view<char, std::char_traits<char>>&, String&&, String&&) @ 0x00000000362b8900 in /usr/bin/clickhouse
3. ./build_docker/./src/Core/Block.cpp:38: void DB::onError<void, std::basic_string_view<char, std::char_traits<char>>&, String, String>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, std::basic_string_view<char, std::char_traits<char>>&, String&&, String&&) @ 0x00000000362aa1cf in /usr/bin/clickhouse
4. ./build_docker/./src/Core/Block.cpp:0: void DB::checkColumnStructure<void>(DB::ColumnWithTypeAndName const&, DB::ColumnWithTypeAndName const&, std::basic_string_view<char, std::char_traits<char>>, bool, int) @ 0x000000003629272f in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.cpp:0: DB::Block::insert(DB::ColumnWithTypeAndName) @ 0x0000000036293026 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::FullSortingMergeJoin::joinBlock(DB::Block&, std::shared_ptr<DB::ExtraBlock>&) @ 0x0000000037d12dc3 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/JoiningTransform.cpp:0: DB::JoiningTransform::transformHeader(DB::Block, std::shared_ptr<DB::IJoin> const&) @ 0x000000003ebb5709 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:29: DB::JoinStep::JoinStep(DB::DataStream const&, DB::DataStream const&, std::shared_ptr<DB::IJoin>, unsigned long, unsigned long, bool) @ 0x000000003f13c013 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b54989 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:31.587596 [ 2438 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:31.594861 [ 3994 ] {16afa897-923b-4c90-a1d7-d6a00cb9d2d6} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:31.952094 [ 2950 ] {02450_kill_distributed_query_deadlock_test_1-19} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:437: DB::QueryStatus::addPipelineExecutor(DB::PipelineExecutor*) @ 0x0000000039fa267b in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::PipelineExecutor(std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>) @ 0x000000003e1fa172 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::PipelineExecutor> std::allocate_shared[abi:v15000]<DB::PipelineExecutor, std::allocator<DB::PipelineExecutor>, std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>&, void>(std::allocator<DB::PipelineExecutor> const&, std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>&) @ 0x0000000036a67d88 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000003e230e2f in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:153: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000003e232905 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:914: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c321c in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:32.595464 [ 2436 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:32.825652 [ 2950 ] {02450_kill_distributed_query_deadlock_test_1-20} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41152) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:32.837913 [ 2950 ] {02450_kill_distributed_query_deadlock_test_1-20} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:32.991312 [ 6599 ] {3001096d-b96f-482b-aa8c-449c7a30d0b6} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:33202). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33202) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:32.995379 [ 6599 ] {3001096d-b96f-482b-aa8c-449c7a30d0b6} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:33202). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:32.995714 [ 6599 ] {3001096d-b96f-482b-aa8c-449c7a30d0b6} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:33202). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:33.007659 [ 6599 ] {3001096d-b96f-482b-aa8c-449c7a30d0b6} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:33.554758 [ 6599 ] {02450_kill_distributed_query_deadlock_test_1-21} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41228) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:33.569331 [ 6599 ] {02450_kill_distributed_query_deadlock_test_1-21} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:33.598747 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:33.661893 [ 3151 ] {5c244e88-32c3-4b39-b256-29939608f412} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:58390). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:58390) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:33.678750 [ 3151 ] {5c244e88-32c3-4b39-b256-29939608f412} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:58390). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:33.679050 [ 3151 ] {5c244e88-32c3-4b39-b256-29939608f412} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:58390). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:33.689313 [ 3151 ] {5c244e88-32c3-4b39-b256-29939608f412} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:34.522725 [ 3151 ] {02450_kill_distributed_query_deadlock_test_1-22} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41264) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:34.545143 [ 3151 ] {02450_kill_distributed_query_deadlock_test_1-22} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:34.621386 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:34.650830 [ 3207 ] {db5c1eb7-544d-456c-a317-dd2d085638bb} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:58626). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:58626) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:34.742932 [ 3207 ] {db5c1eb7-544d-456c-a317-dd2d085638bb} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:58626). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:34.743265 [ 3207 ] {db5c1eb7-544d-456c-a317-dd2d085638bb} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:58626). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:34.748860 [ 3207 ] {db5c1eb7-544d-456c-a317-dd2d085638bb} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:37.138900 [ 2384 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:37.141767 [ 6603 ] {8a006819-8913-45b5-b848-a617e601a313} <Error> executeQuery: Code: 36. DB::Exception: Second argument of aggregate function analysisOfVariance should be a native unsigned integer. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44072) (comment: 02475_analysis_of_variance.sql) (in query: SELECT analysisOfVariance(1.11, -20);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionAnalysisOfVariance.cpp:24: DB::(anonymous namespace)::createAggregateFunctionAnalysisOfVariance(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x000000002ad90862 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IAggregateFunction const> std::__function::__policy_invoker<std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IAggregateFunction const> (*)(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*), std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>>(std::__function::__policy_storage const*, String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000021359323 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035301e96 in /usr/bin/clickhouse
6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:37.747764 [ 3182 ] {85add469-42fe-4851-8a9b-e935abeab34d} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 3.68 MiB (attempt to allocate chunk of 1404744 bytes), maximum: 9.31 GiB: While executing Numbers. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59924) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x0000000034b5779a in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:37.747773 [ 6603 ] {8a006819-8913-45b5-b848-a617e601a313} <Error> TCPHandler: Code: 36. DB::Exception: Second argument of aggregate function analysisOfVariance should be a native unsigned integer. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionAnalysisOfVariance.cpp:24: DB::(anonymous namespace)::createAggregateFunctionAnalysisOfVariance(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x000000002ad90862 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IAggregateFunction const> std::__function::__policy_invoker<std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IAggregateFunction const> (*)(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*), std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>>(std::__function::__policy_storage const*, String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000021359323 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035301e96 in /usr/bin/clickhouse
6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:37.747859 [ 3990 ] {02450_kill_distributed_query_deadlock_test_1-23} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44094) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:37.749420 [ 3182 ] {85add469-42fe-4851-8a9b-e935abeab34d} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 3.68 MiB (attempt to allocate chunk of 1404744 bytes), maximum: 9.31 GiB: While executing Numbers. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x0000000034b5779a in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:37.824592 [ 3990 ] {02450_kill_distributed_query_deadlock_test_1-23} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:37.854669 [ 3182 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:59924). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:37.914990 [ 6603 ] {2a9c89de-88b3-471e-90b4-66b8c81ec21c} <Error> executeQuery: Code: 36. DB::Exception: Second argument of aggregate function analysisOfVariance should be a native unsigned integer. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44072) (comment: 02475_analysis_of_variance.sql) (in query: SELECT analysisOfVariance(1.11, 20 :: UInt128);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionAnalysisOfVariance.cpp:24: DB::(anonymous namespace)::createAggregateFunctionAnalysisOfVariance(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x000000002ad90862 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IAggregateFunction const> std::__function::__policy_invoker<std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IAggregateFunction const> (*)(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*), std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>>(std::__function::__policy_storage const*, String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000021359323 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035301e96 in /usr/bin/clickhouse
6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:37.918899 [ 6603 ] {2a9c89de-88b3-471e-90b4-66b8c81ec21c} <Error> TCPHandler: Code: 36. DB::Exception: Second argument of aggregate function analysisOfVariance should be a native unsigned integer. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionAnalysisOfVariance.cpp:24: DB::(anonymous namespace)::createAggregateFunctionAnalysisOfVariance(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x000000002ad90862 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IAggregateFunction const> std::__function::__policy_invoker<std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IAggregateFunction const> (*)(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*), std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>>(std::__function::__policy_storage const*, String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000021359323 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035301e96 in /usr/bin/clickhouse
6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:39.129094 [ 2759 ] {02450_kill_distributed_query_deadlock_test_1-24} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44178) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:39.129115 [ 6603 ] {3c4e0685-6d4f-4079-b6ab-601dc80a72d9} <Error> executeQuery: Code: 36. DB::Exception: Too many groups for analysis of variance (should be no more than 1048576, got 9000000000000001): While executing AggregatingTransform. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44072) (comment: 02475_analysis_of_variance.sql) (in query: SELECT analysisOfVariance(1.11, 9000000000000000);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type, std::type_identity<unsigned long&>::type>, unsigned long const&, unsigned long&) @ 0x000000000a736eac in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/Moments.h:452: DB::AnalysisOfVarianceMoments<double>::resizeIfNeeded(unsigned long) @ 0x000000002ad9a078 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1457: DB::AnalysisOfVarianceMoments<double>::add(double, unsigned long) @ 0x000000002ad99964 in /usr/bin/clickhouse
5. ./build_docker/./src/AggregateFunctions/IAggregateFunction.h:541: DB::IAggregateFunctionHelper<DB::AggregateFunctionAnalysisOfVariance>::addBatchSinglePlace(unsigned long, unsigned long, char*, DB::IColumn const**, DB::Arena*, long) const @ 0x000000002ad9666a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeWithoutKeyImpl<false>(char*&, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, DB::Arena*) const @ 0x000000003806900f in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:1586: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037dea927 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:39.129462 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:39.132207 [ 6603 ] {3c4e0685-6d4f-4079-b6ab-601dc80a72d9} <Error> TCPHandler: Code: 36. DB::Exception: Too many groups for analysis of variance (should be no more than 1048576, got 9000000000000001): While executing AggregatingTransform. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type, std::type_identity<unsigned long&>::type>, unsigned long const&, unsigned long&) @ 0x000000000a736eac in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/Moments.h:452: DB::AnalysisOfVarianceMoments<double>::resizeIfNeeded(unsigned long) @ 0x000000002ad9a078 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1457: DB::AnalysisOfVarianceMoments<double>::add(double, unsigned long) @ 0x000000002ad99964 in /usr/bin/clickhouse
5. ./build_docker/./src/AggregateFunctions/IAggregateFunction.h:541: DB::IAggregateFunctionHelper<DB::AggregateFunctionAnalysisOfVariance>::addBatchSinglePlace(unsigned long, unsigned long, char*, DB::IColumn const**, DB::Arena*, long) const @ 0x000000002ad9666a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeWithoutKeyImpl<false>(char*&, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, DB::Arena*) const @ 0x000000003806900f in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:1586: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037dea927 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:39.154757 [ 2759 ] {02450_kill_distributed_query_deadlock_test_1-24} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:39.165261 [ 3182 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:58642). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:39.982235 [ 3239 ] {02450_kill_distributed_query_deadlock_test_1-25} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44188) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:39.993952 [ 3239 ] {02450_kill_distributed_query_deadlock_test_1-25} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:40.099965 [ 3182 ] {ca97f15c-6a12-47f8-932e-0d8f10f237ee} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:59934). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59934) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:40.142259 [ 2350 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:40.149952 [ 3182 ] {ca97f15c-6a12-47f8-932e-0d8f10f237ee} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:59934). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:40.150261 [ 3182 ] {ca97f15c-6a12-47f8-932e-0d8f10f237ee} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:59934). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:40.188188 [ 3182 ] {ca97f15c-6a12-47f8-932e-0d8f10f237ee} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:41.155671 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:41.322769 [ 6599 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:55978). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:42.041690 [ 3990 ] {02450_kill_distributed_query_deadlock_test_1-26} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44222) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:42.043650 [ 2950 ] {dc6b887e-05ec-4681-87ae-718a2f122e5a} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 107.55 MiB (attempt to allocate chunk of 1056768 bytes), maximum: 9.31 GiB: while receiving packet from 127.0.0.2:9000: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41204) (comment: 00147_global_in_aggregate_function.sql) (in query: SELECT sum(UserID GLOBAL IN (SELECT UserID FROM remote('127.0.0.{1,2}', test.hits))) FROM remote('127.0.0.{1,2}', test.hits);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
9. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::Connection::receiveDataImpl(DB::NativeReader&) @ 0x000000003dd93dca in /usr/bin/clickhouse
13. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x000000003dd9048c in /usr/bin/clickhouse
14. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
17. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:29:42.079764 [ 3990 ] {02450_kill_distributed_query_deadlock_test_1-26} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:42.117067 [ 3182 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:57900). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:42.163158 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:42.357197 [ 3976 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:36928). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:42.670799 [ 2950 ] {dc6b887e-05ec-4681-87ae-718a2f122e5a} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 107.55 MiB (attempt to allocate chunk of 1056768 bytes), maximum: 9.31 GiB: while receiving packet from 127.0.0.2:9000: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
9. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::Connection::receiveDataImpl(DB::NativeReader&) @ 0x000000003dd93dca in /usr/bin/clickhouse
13. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x000000003dd9048c in /usr/bin/clickhouse
14. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
17. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:29:42.883379 [ 3182 ] {02450_kill_distributed_query_deadlock_test_1-27} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44308) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:42.917150 [ 3182 ] {02450_kill_distributed_query_deadlock_test_1-27} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:43.070709 [ 3186 ] {9469292e-6d76-4d34-a246-ec7caa1db885} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:57904). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:57904) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:43.101028 [ 3186 ] {9469292e-6d76-4d34-a246-ec7caa1db885} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:57904). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:43.101345 [ 3186 ] {9469292e-6d76-4d34-a246-ec7caa1db885} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:57904). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:43.171882 [ 3186 ] {9469292e-6d76-4d34-a246-ec7caa1db885} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:43.215104 [ 2412 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:44.271648 [ 2442 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:44.615589 [ 6597 ] {02450_kill_distributed_query_deadlock_test_1-28} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44334) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:44.685686 [ 6597 ] {02450_kill_distributed_query_deadlock_test_1-28} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:44.747659 [ 3990 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52546). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:45.307061 [ 2396 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:46.123665 [ 3987 ] {b082a839-d776-4c5d-86dc-2baddf1e1c8a} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 136.07 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59936) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT `RegionID`, uniqHLL12(`WatchID`) AS `X` FROM `test`.`hits` GROUP BY `RegionID` HAVING `X` > 100000 ORDER BY `RegionID` ASC), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:46.333573 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:46.803921 [ 6597 ] {02450_kill_distributed_query_deadlock_test_1-29} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44556) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:46.888446 [ 6597 ] {02450_kill_distributed_query_deadlock_test_1-29} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:46.934742 [ 3993 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:47300). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:47.401898 [ 2464 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:48.016129 [ 3993 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:42562). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000020a094ce in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a581e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:48.404978 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:49.406802 [ 2357 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:50.374897 [ 3107 ] {0ae43412-6bde-4beb-a1fa-28a4cfdd491c} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 3.68 MiB (attempt to allocate chunk of 1404744 bytes), maximum: 9.31 GiB: While executing Numbers. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51510) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x0000000034b5779a in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:50.419196 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:50.854890 [ 3107 ] {0ae43412-6bde-4beb-a1fa-28a4cfdd491c} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 3.68 MiB (attempt to allocate chunk of 1404744 bytes), maximum: 9.31 GiB: While executing Numbers. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x0000000034b5779a in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:51.431228 [ 2365 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:51.993583 [ 6637 ] {02450_kill_distributed_query_deadlock_test_1-30} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44594) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:52.152505 [ 6637 ] {02450_kill_distributed_query_deadlock_test_1-30} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:52.191929 [ 3107 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:51510). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:52.474327 [ 2397 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:53.399960 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-31} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44642) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:53.413096 [ 3987 ] {b082a839-d776-4c5d-86dc-2baddf1e1c8a} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 136.07 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:53.413432 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-31} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:53.505024 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:53.593655 [ 3239 ] {820ab9b3-4ccb-41ab-acb4-54faa3b85cf0} <Error> executeQuery: Code: 241. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Memory tracker (for query): fault injected. Would use 136.07 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44314) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT RegionID, uniqHLL12(WatchID) AS X FROM remote('127.0.0.{1,2}', test, hits) GROUP BY RegionID HAVING X > 100000 ORDER BY RegionID ASC;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:29:54.550181 [ 3993 ] {1b6ff668-08e1-44ee-97c0-4a90e88ff324} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:51532). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51532) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:54.552407 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:54.631473 [ 3993 ] {1b6ff668-08e1-44ee-97c0-4a90e88ff324} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:51532). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:54.631841 [ 3993 ] {1b6ff668-08e1-44ee-97c0-4a90e88ff324} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:51532). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:54.689864 [ 3993 ] {1b6ff668-08e1-44ee-97c0-4a90e88ff324} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:54.716205 [ 4381 ] {7f9ab64d-13cd-4437-9040-2e867b3da8dd} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:57906). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:57906) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT `RegionID`, uniqHLL12(`WatchID`) AS `X` FROM `test`.`hits` GROUP BY `RegionID` HAVING `X` > 100000 ORDER BY `RegionID` ASC), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:54.728486 [ 4381 ] {7f9ab64d-13cd-4437-9040-2e867b3da8dd} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:57906). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:54.728838 [ 4381 ] {7f9ab64d-13cd-4437-9040-2e867b3da8dd} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:57906). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:54.795389 [ 4381 ] {7f9ab64d-13cd-4437-9040-2e867b3da8dd} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:29:55.065746 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-32} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44688) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:55.240808 [ 2860 ] {02450_kill_distributed_query_deadlock_test_1-32} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:55.266766 [ 3994 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:51546). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:56.138229 [ 3239 ] {820ab9b3-4ccb-41ab-acb4-54faa3b85cf0} <Error> TCPHandler: Code: 241. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Memory tracker (for query): fault injected. Would use 136.07 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:29:56.160998 [ 2461 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:56.282683 [ 6598 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:35158). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000020a094ce in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a581e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:56.978433 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-33} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52468) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:57.041546 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-33} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:57.138948 [ 2860 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:57740). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:57.186935 [ 2465 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:58.267525 [ 3232 ] {2c1a2c73-25c3-452a-bcea-c213874e2db9} <Warning> test_rhy6tku0.table_two (1c6d5c37-6175-4351-803f-1f21826bd436): Table can't create parts with adaptive granularity, but settings min_rows_for_wide_part = 0, min_bytes_for_wide_part = 100. Parts with non-adaptive granularity can be stored only in Wide (default) format. Settings 'min_rows_for_wide_part'and 'min_bytes_for_wide_part' will be ignored.
2024.09.24 02:29:58.858969 [ 2751 ] {ef02073d-4129-447a-bc78-64b28637dcb2} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 750.92 MiB (attempt to allocate chunk of 1441792 bytes), maximum: 9.31 GiB: While executing MergeSortingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35446) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format JSONCompactEachRow ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
7. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c885f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:493: DB::ColumnVector<unsigned int>::insertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x000000003b2afe86 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/SortingTransform.cpp:113: DB::Chunk DB::MergeSorter::mergeBatchImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)1>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)1>&) @ 0x000000003ed2bdc1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergeSorter::read()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)1>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergeSorter::read()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)1>>&) @ 0x000000003ec4f133 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/variant:0: DB::MergeSorter::read() @ 0x000000003ec373e8 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/MergeSortingTransform.cpp:236: DB::MergeSortingTransform::generate() @ 0x000000003ec0b961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/SortingTransform.cpp:354: DB::SortingTransform::work() @ 0x000000003ec479a4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
18. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:58.859134 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:29:58.859162 [ 6598 ] {02450_kill_distributed_query_deadlock_test_1-34} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52508) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:437: DB::QueryStatus::addPipelineExecutor(DB::PipelineExecutor*) @ 0x0000000039fa267b in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::PipelineExecutor(std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>) @ 0x000000003e1fa172 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::PipelineExecutor> std::allocate_shared[abi:v15000]<DB::PipelineExecutor, std::allocator<DB::PipelineExecutor>, std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>&, void>(std::allocator<DB::PipelineExecutor> const&, std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>&) @ 0x0000000036a67d88 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000003e230e2f in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:153: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000003e232905 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:914: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c321c in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:58.863841 [ 6598 ] {02450_kill_distributed_query_deadlock_test_1-34} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:437: DB::QueryStatus::addPipelineExecutor(DB::PipelineExecutor*) @ 0x0000000039fa267b in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::PipelineExecutor(std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>) @ 0x000000003e1fa172 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::PipelineExecutor> std::allocate_shared[abi:v15000]<DB::PipelineExecutor, std::allocator<DB::PipelineExecutor>, std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>&, void>(std::allocator<DB::PipelineExecutor> const&, std::shared_ptr<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::shared_ptr<DB::QueryStatus>&) @ 0x0000000036a67d88 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000003e230e2f in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:153: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000003e232905 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:914: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c321c in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:29:59.860404 [ 2361 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:00.401224 [ 2782 ] {02450_kill_distributed_query_deadlock_test_1-35} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52554) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:00.528176 [ 2782 ] {02450_kill_distributed_query_deadlock_test_1-35} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:00.546795 [ 2950 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:48368). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000020a094ce in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a581e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:00.551008 [ 2905 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:55618). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:00.882710 [ 2367 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:01.527500 [ 2782 ] {02450_kill_distributed_query_deadlock_test_1-36} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52572) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:01.541511 [ 2782 ] {02450_kill_distributed_query_deadlock_test_1-36} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:01.637570 [ 2905 ] {7b60fbd7-cee1-4d87-9171-8ef1c67907fb} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48370). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48370) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:01.652096 [ 2905 ] {7b60fbd7-cee1-4d87-9171-8ef1c67907fb} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48370). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:01.652443 [ 2905 ] {7b60fbd7-cee1-4d87-9171-8ef1c67907fb} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48370). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:01.685805 [ 2905 ] {7b60fbd7-cee1-4d87-9171-8ef1c67907fb} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:01.897110 [ 2404 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:02.240821 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-37} <Error> executeQuery: Code: 394. DB::Exception: Query '02450_kill_distributed_query_deadlock_test_1-37' is killed in pending state. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52574) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/executeQuery.cpp:1122: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a9272 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:02.247056 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-37} <Error> TCPHandler: Code: 394. DB::Exception: Query '02450_kill_distributed_query_deadlock_test_1-37' is killed in pending state. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/executeQuery.cpp:1122: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a9272 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:02.922757 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:03.287602 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-38} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52598) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:03.304769 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-38} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:03.390397 [ 2905 ] {685ada8c-465d-4de1-801f-93164f732c94} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55620). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:55620) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:03.477189 [ 2905 ] {685ada8c-465d-4de1-801f-93164f732c94} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55620). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:03.477544 [ 2905 ] {685ada8c-465d-4de1-801f-93164f732c94} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55620). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:03.505586 [ 2905 ] {685ada8c-465d-4de1-801f-93164f732c94} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:03.943091 [ 2401 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:04.012841 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-39} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52624) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:04.031930 [ 3994 ] {02450_kill_distributed_query_deadlock_test_1-39} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:04.411528 [ 2905 ] {8643d0ae-1cce-4505-98d3-252d03556dc6} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55630). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:55630) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:04.465799 [ 2905 ] {8643d0ae-1cce-4505-98d3-252d03556dc6} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55630). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:04.466075 [ 2905 ] {8643d0ae-1cce-4505-98d3-252d03556dc6} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:55630). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:04.490699 [ 2905 ] {8643d0ae-1cce-4505-98d3-252d03556dc6} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:04.920387 [ 3983 ] {02450_kill_distributed_query_deadlock_test_1-40} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55932) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:04.943053 [ 3983 ] {02450_kill_distributed_query_deadlock_test_1-40} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:04.963908 [ 2341 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:05.061247 [ 2905 ] {a407a76b-e958-4d1c-9db6-064b7c1830c9} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:40714). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40714) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:05.123087 [ 2905 ] {a407a76b-e958-4d1c-9db6-064b7c1830c9} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:40714). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:05.123632 [ 2905 ] {a407a76b-e958-4d1c-9db6-064b7c1830c9} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:40714). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:05.177261 [ 2905 ] {a407a76b-e958-4d1c-9db6-064b7c1830c9} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:05.980514 [ 2362 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:06.079343 [ 2950 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:34978). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000020a094ce in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a581e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:06.506957 [ 2905 ] {02450_kill_distributed_query_deadlock_test_1-41} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55962) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:06.572402 [ 2905 ] {02450_kill_distributed_query_deadlock_test_1-41} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:06.583928 [ 3994 ] {daafdb40-efda-4f3d-86fc-d75b25549c02} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:42988). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42988) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:06.641500 [ 3994 ] {daafdb40-efda-4f3d-86fc-d75b25549c02} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:42988). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:06.641923 [ 3994 ] {daafdb40-efda-4f3d-86fc-d75b25549c02} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:42988). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:06.655324 [ 2751 ] {ef02073d-4129-447a-bc78-64b28637dcb2} <Error> DynamicQueryHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 750.92 MiB (attempt to allocate chunk of 1441792 bytes), maximum: 9.31 GiB: While executing MergeSortingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
7. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c885f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:493: DB::ColumnVector<unsigned int>::insertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x000000003b2afe86 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/SortingTransform.cpp:113: DB::Chunk DB::MergeSorter::mergeBatchImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)1>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)1>&) @ 0x000000003ed2bdc1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergeSorter::read()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)1>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergeSorter::read()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)1>>&) @ 0x000000003ec4f133 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/variant:0: DB::MergeSorter::read() @ 0x000000003ec373e8 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/MergeSortingTransform.cpp:236: DB::MergeSortingTransform::generate() @ 0x000000003ec0b961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/SortingTransform.cpp:354: DB::SortingTransform::work() @ 0x000000003ec479a4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
18. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:06.711162 [ 3994 ] {daafdb40-efda-4f3d-86fc-d75b25549c02} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:06.986892 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:07.231200 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-42} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55970) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:07.256483 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-42} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:07.387445 [ 2950 ] {92225538-d1ac-4631-9a04-d369503a1fb5} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:43002). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43002) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:07.418820 [ 2950 ] {92225538-d1ac-4631-9a04-d369503a1fb5} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:43002). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:07.420472 [ 2950 ] {92225538-d1ac-4631-9a04-d369503a1fb5} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:43002). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:07.462480 [ 2950 ] {92225538-d1ac-4631-9a04-d369503a1fb5} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:07.993578 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:08.994459 [ 2432 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:09.788473 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-43} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56006) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:09.878443 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-43} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:09.957257 [ 6638 ] {96ba72e5-eea7-4eaf-9867-a1d909a72df1} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:33996). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33996) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:10.034203 [ 2454 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:10.038768 [ 6638 ] {96ba72e5-eea7-4eaf-9867-a1d909a72df1} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:33996). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:10.039189 [ 6638 ] {96ba72e5-eea7-4eaf-9867-a1d909a72df1} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:33996). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c367a in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:10.079011 [ 6638 ] {96ba72e5-eea7-4eaf-9867-a1d909a72df1} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:10.561930 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-44} <Error> executeQuery: Code: 394. DB::Exception: Query '02450_kill_distributed_query_deadlock_test_1-44' is killed in pending state. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56046) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/executeQuery.cpp:1122: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a9272 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:10.571041 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-44} <Error> TCPHandler: Code: 394. DB::Exception: Query '02450_kill_distributed_query_deadlock_test_1-44' is killed in pending state. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/executeQuery.cpp:1122: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a9272 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:11.059087 [ 2346 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:12.061245 [ 2353 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:12.197293 [ 3207 ] {02450_kill_distributed_query_deadlock_test_1-45} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56086) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:12.236473 [ 3207 ] {02450_kill_distributed_query_deadlock_test_1-45} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:12.248877 [ 3982 ] {52c8e42d-01b0-48ba-8625-d98a3558103e} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:43018). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43018) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:12.305010 [ 3982 ] {52c8e42d-01b0-48ba-8625-d98a3558103e} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:43018). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:12.305380 [ 3982 ] {52c8e42d-01b0-48ba-8625-d98a3558103e} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:43018). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:12.314473 [ 3982 ] {52c8e42d-01b0-48ba-8625-d98a3558103e} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:13.088607 [ 2388 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:13.206857 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-46} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56116) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:13.221059 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-46} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:13.782595 [ 3139 ] {93377d4f-6129-4200-a623-99e0da4d81f4} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:33710). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33710) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:13.823298 [ 3139 ] {93377d4f-6129-4200-a623-99e0da4d81f4} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:33710). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:13.823627 [ 3139 ] {93377d4f-6129-4200-a623-99e0da4d81f4} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:33710). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:13.839523 [ 3139 ] {93377d4f-6129-4200-a623-99e0da4d81f4} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:15.483364 [ 2394 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:15.483415 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-47} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56132) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:15.493879 [ 6603 ] {bef793e1-fae5-4be3-8ab8-1022d1f05acb} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million: While processing (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery64: While processing 1 = ((SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery64). (TOO_MANY_ROWS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56128) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 = (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:233: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f2c24 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f69314 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f687be in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ff in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.h:35: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context const>, unsigned long, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, bool, bool) @ 0x000000003a70965e in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a6f91d4 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:30:15.495404 [ 3982 ] {02450_kill_distributed_query_deadlock_test_1-47} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:15.504145 [ 6603 ] {bef793e1-fae5-4be3-8ab8-1022d1f05acb} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million: While processing (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery64: While processing 1 = ((SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery64). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:233: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f2c24 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f69314 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f687be in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ff in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.h:35: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context const>, unsigned long, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, bool, bool) @ 0x000000003a70965e in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a6f91d4 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:30:15.509035 [ 3139 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:34000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:16.159275 [ 3139 ] {02450_kill_distributed_query_deadlock_test_1-48} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53918) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:16.723752 [ 3139 ] {02450_kill_distributed_query_deadlock_test_1-48} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:16.723797 [ 6603 ] {ae37cc27-3744-40c2-99a5-c8b03c24b812} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million. (TOO_MANY_ROWS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56128) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:233: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f2c24 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:16.723895 [ 3186 ] {34e00cb5-f955-4581-938a-1d5d4ca94ff4} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48606). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48606) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:16.727826 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:16.746423 [ 6603 ] {ae37cc27-3744-40c2-99a5-c8b03c24b812} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:233: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f2c24 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:16.751159 [ 3186 ] {34e00cb5-f955-4581-938a-1d5d4ca94ff4} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48606). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:16.751540 [ 3186 ] {34e00cb5-f955-4581-938a-1d5d4ca94ff4} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48606). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:16.773876 [ 3186 ] {34e00cb5-f955-4581-938a-1d5d4ca94ff4} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:17.728437 [ 2325 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:18.314211 [ 3139 ] {02450_kill_distributed_query_deadlock_test_1-49} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53948) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:18.314251 [ 6603 ] {6209450b-6293-47e9-a954-851a553514de} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 17.75 million: While executing MergeTreeThread. (TOO_MANY_ROWS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56128) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) FROM test.hits WHERE NOT ignore(AdvEngineID);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:18.339307 [ 3139 ] {02450_kill_distributed_query_deadlock_test_1-49} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:18.365516 [ 3186 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52426). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:18.821976 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:18.825359 [ 6603 ] {6209450b-6293-47e9-a954-851a553514de} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 17.75 million: While executing MergeTreeThread. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:19.169065 [ 6638 ] {02450_kill_distributed_query_deadlock_test_1-50} <Error> executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53970) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: select * from remote('127.{1|2|3|4|5|6}', numbers(1e12))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:19.188379 [ 6638 ] {02450_kill_distributed_query_deadlock_test_1-50} <Error> TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [20]>(int, char const (&) [20]) @ 0x000000000a7224d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa3077 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:19.242890 [ 3186 ] {c8f11c31-a9cb-42c0-bf8a-4a44d73eaefb} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48610). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48610) (comment: 02450_kill_distributed_query_deadlock.sh) (in query: SELECT `number` FROM numbers(1000000000000.)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:19.327055 [ 3186 ] {c8f11c31-a9cb-42c0-bf8a-4a44d73eaefb} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48610). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:19.327407 [ 3186 ] {c8f11c31-a9cb-42c0-bf8a-4a44d73eaefb} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:48610). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cb4ea in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:37: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c3f45 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:19.334365 [ 3186 ] {c8f11c31-a9cb-42c0-bf8a-4a44d73eaefb} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:30:20.783327 [ 2342 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:20.787418 [ 6603 ] {6b150ae8-2404-4049-9a8b-ad44d240efaa} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million: While processing (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery67: While processing CounterID > ((SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery67). (TOO_MANY_ROWS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56128) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID > (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:233: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f2c24 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f69314 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f687be in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.h:35: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context const>, unsigned long, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, bool, bool) @ 0x000000003a70965e in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a6f91d4 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:30:20.798936 [ 6603 ] {6b150ae8-2404-4049-9a8b-ad44d240efaa} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million: While processing (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery67: While processing CounterID > ((SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery67). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:233: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f2c24 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f69314 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:0: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f687be in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f7522a in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr<DB::IAST>&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x0000000039f688a3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x0000000039f67655 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor<DB::ExecuteScalarSubqueriesMatcher, true, false, std::shared_ptr<DB::IAST>>::visitChildren<false>(std::shared_ptr<DB::IAST>&) @ 0x0000000039f678ed in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExecuteScalarSubqueriesVisitor.h:35: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context const>, unsigned long, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, std::map<String, DB::Block, std::less<String>, std::allocator<std::pair<String const, DB::Block>>>&, bool, bool) @ 0x000000003a70965e in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a6f91d4 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:30:21.784020 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:22.271484 [ 6603 ] {f80bc5bb-46d4-403b-a60d-a7329195a289} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.11 million: While executing MergeTreeThread. (TOO_MANY_ROWS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56128) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID < (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:22.481586 [ 6603 ] {f80bc5bb-46d4-403b-a60d-a7329195a289} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.11 million: While executing MergeTreeThread. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:22.807452 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:23.403498 [ 3232 ] {895be969-848d-41fd-b4a5-7a6fec81a567} <Error> executeQuery: Code: 36. DB::Exception: Cannot replace partition '0' because part '0_1_1_0' has inconsistent granularity with table. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46776) (comment: 02422_insert_different_granularity.sql) (in query: ALTER TABLE table_two REPLACE PARTITION 0 FROM table_one;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String const&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String const&>::type>, String&, String const&) @ 0x0000000020b56f35 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da7db31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<DB::PartitionCommand, std::allocator<DB::PartitionCommand>> const&, std::shared_ptr<DB::Context const>) @ 0x000000003cf38e8c in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fa088 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:23.411067 [ 3232 ] {895be969-848d-41fd-b4a5-7a6fec81a567} <Error> TCPHandler: Code: 36. DB::Exception: Cannot replace partition '0' because part '0_1_1_0' has inconsistent granularity with table. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String const&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String const&>::type>, String&, String const&) @ 0x0000000020b56f35 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da7db31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<DB::PartitionCommand, std::allocator<DB::PartitionCommand>> const&, std::shared_ptr<DB::Context const>) @ 0x000000003cf38e8c in /usr/bin/clickhouse
5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fa088 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:23.822011 [ 2324 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:24.830206 [ 2325 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:25.059928 [ 6638 ] {4b7b8f23-179f-4f3a-8eab-ce49eaab603c} <Warning> DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments
2024.09.24 02:30:25.061260 [ 6638 ] {4b7b8f23-179f-4f3a-8eab-ce49eaab603c} <Error> executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52684) (comment: 02723_zookeeper_name.sql) (in query: CREATE TABLE t1 (`k` UInt32, `v` UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{database}/test_02723/zookeeper_name/t1', '1') ORDER BY k SETTINGS index_granularity = 62372, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0.7724969983100891, merge_max_block_size = 22591, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 117749, vertical_merge_algorithm_min_columns_to_activate = 70, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 25065369, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 86953, primary_key_compress_block_size = 75859), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:25.064450 [ 6638 ] {4b7b8f23-179f-4f3a-8eab-ce49eaab603c} <Error> TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:25.852501 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:26.872074 [ 2439 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:28.597848 [ 2424 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:28.597880 [ 4381 ] {32db00dc-e967-4e11-9db2-64a7be22563e} <Error> executeQuery: Code: 27. DB::ParsingException: Cannot parse input: expected '\t' before: 'number\tname\n1\tClickHouse\n2\tHello\n3\tHedhehog\n': 
Row 1:
Column 0,   name: c1, type: UInt64, ERROR: text "number<TAB>nam" is not like UInt64

: While executing TabSeparatedRowInputFormat: While executing URL: (in file/uri http://localhost:11111/test/tsv_with_header.tsv): (at row 1)
. (CANNOT_PARSE_INPUT_ASSERTION_FAILED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52736) (comment: 02270_errors_in_files_s3.sh) (in query: SELECT * FROM url('http://localhost:11111/test/{a,tsv_with_header}.tsv', 'TSV', 'c1 UInt64, c2 UInt64, c3 UInt64')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsingException::ParsingException<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000209f4f19 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadHelpers.cpp:92: DB::throwAtAssertionFailed(char const*, DB::ReadBuffer&) @ 0x00000000209adb77 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadHelpers.h:0: DB::TabSeparatedFormatReader::skipFieldDelimiter() @ 0x000000003ea53677 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Formats/RowInputFormatWithNamesAndTypes.cpp:0: DB::RowInputFormatWithNamesAndTypes::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003e492452 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/StorageURL.cpp:0: DB::StorageURLSource::generate() @ 0x000000003c4c0b93 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:28.634741 [ 4381 ] {32db00dc-e967-4e11-9db2-64a7be22563e} <Error> TCPHandler: Code: 27. DB::ParsingException: Cannot parse input: expected '\t' before: 'number\tname\n1\tClickHouse\n2\tHello\n3\tHedhehog\n': 
Row 1:
Column 0,   name: c1, type: UInt64, ERROR: text "number<TAB>nam" is not like UInt64

: While executing TabSeparatedRowInputFormat: While executing URL: (in file/uri http://localhost:11111/test/tsv_with_header.tsv): (at row 1)
. (CANNOT_PARSE_INPUT_ASSERTION_FAILED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsingException::ParsingException<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000209f4f19 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadHelpers.cpp:92: DB::throwAtAssertionFailed(char const*, DB::ReadBuffer&) @ 0x00000000209adb77 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadHelpers.h:0: DB::TabSeparatedFormatReader::skipFieldDelimiter() @ 0x000000003ea53677 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Formats/RowInputFormatWithNamesAndTypes.cpp:0: DB::RowInputFormatWithNamesAndTypes::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003e492452 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/StorageURL.cpp:0: DB::StorageURLSource::generate() @ 0x000000003c4c0b93 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:29.396197 [ 3981 ] {78fcdf19-2234-4ca0-a535-90c43e4e08b0} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52834) (comment: 02483_cuturlparameter_with_arrays.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:29.406819 [ 3981 ] {78fcdf19-2234-4ca0-a535-90c43e4e08b0} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:29.599555 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:30.608299 [ 2368 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:31.621145 [ 2362 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:32.630893 [ 2415 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:33.367681 [ 3991 ] {4efaffec-07b3-4d01-866c-a8b7a9622bdf} <Error> executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52926) (comment: 01825_type_json_multiple_files.sh) (in query: select _path,_file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:33.372140 [ 3991 ] {4efaffec-07b3-4d01-866c-a8b7a9622bdf} <Error> TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:34.804863 [ 3981 ] {f0485fe9-4a34-436c-9b97-f82f90d2ad93} <Error> executeQuery: Code: 117. DB::Exception: Incorrect arguments h3Index: 579205132326352334, k: 1, error: 1: While processing h3HexRing(579205132326352334, toUInt16(1)) AS hexRing. (INCORRECT_DATA) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52920) (comment: 02293_h3_hex_ring.sql) (in query: SELECT h3HexRing(579205132326352334, toUInt16(1)) as hexRing;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&, int const&, unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type, std::type_identity<int const&>::type, std::type_identity<unsigned int&>::type>, unsigned long const&, int const&, unsigned int&) @ 0x000000001361de4a in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionH3HexRing::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001361be40 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:30:34.810391 [ 2375 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:34.812960 [ 3981 ] {f0485fe9-4a34-436c-9b97-f82f90d2ad93} <Error> TCPHandler: Code: 117. DB::Exception: Incorrect arguments h3Index: 579205132326352334, k: 1, error: 1: While processing h3HexRing(579205132326352334, toUInt16(1)) AS hexRing. (INCORRECT_DATA), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long const&, int const&, unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned long const&>::type, std::type_identity<int const&>::type, std::type_identity<unsigned int&>::type>, unsigned long const&, int const&, unsigned int&) @ 0x000000001361de4a in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionH3HexRing::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001361be40 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:30:36.735117 [ 3981 ] {1c2762fa-2496-46f3-89d5-f2d915b55d86} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Int8 of argument 2 of function h3HexRing. Must be UInt16: While processing h3HexRing(581276613233082367, -1). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52920) (comment: 02293_h3_hex_ring.sql) (in query: SELECT h3HexRing(581276613233082367, -1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, int, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<int>::type, std::type_identity<String>::type>, String&&, int&&, String&&) @ 0x0000000010f65c7e in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionH3HexRing::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001361d17f in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:30:36.738622 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:36.752394 [ 3981 ] {1c2762fa-2496-46f3-89d5-f2d915b55d86} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Int8 of argument 2 of function h3HexRing. Must be UInt16: While processing h3HexRing(581276613233082367, -1). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, int, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<int>::type, std::type_identity<String>::type>, String&&, int&&, String&&) @ 0x0000000010f65c7e in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionH3HexRing::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001361d17f in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:30:38.236641 [ 2433 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:38.236731 [ 3981 ] {44a2fce8-45c0-42b0-8422-d26cbabb3d44} <Error> executeQuery: Code: 12. DB::Exception: Too large 'k' argument for h3HexRing function, maximum 10000: While processing h3HexRing(581276613233082367, toUInt16(-1)). (PARAMETER_OUT_OF_BOUND) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52920) (comment: 02293_h3_hex_ring.sql) (in query: SELECT h3HexRing(581276613233082367, toUInt16(-1));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, int const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<int const&>::type>, String&&, int const&) @ 0x000000001361d92d in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionH3HexRing::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001361bcc4 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:30:39.177997 [ 3981 ] {44a2fce8-45c0-42b0-8422-d26cbabb3d44} <Error> TCPHandler: Code: 12. DB::Exception: Too large 'k' argument for h3HexRing function, maximum 10000: While processing h3HexRing(581276613233082367, toUInt16(-1)). (PARAMETER_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, int const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<int const&>::type>, String&&, int const&) @ 0x000000001361d92d in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionH3HexRing::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001361bcc4 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:30:39.178082 [ 4381 ] {9610d62e-6800-4ade-9ef4-6bd6d99ac15b} <Error> executeQuery: Code: 27. DB::ParsingException: Cannot parse input: expected '\t' before: 'number\tname\n1\tClickHouse\n2\tHello\n3\tHedhehog\n': 
Row 1:
Column 0,   name: c1, type: UInt64, ERROR: text "number<TAB>nam" is not like UInt64

: While executing TabSeparatedRowInputFormat: While executing S3: (in file/uri test/tsv_with_header.tsv): (at row 1)
. (CANNOT_PARSE_INPUT_ASSERTION_FAILED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52824) (comment: 02270_errors_in_files_s3.sh) (in query: SELECT * FROM s3('http://localhost:11111/test/{a,tsv_with_header}.tsv', 'TSV', 'c1 UInt64, c2 UInt64, c3 UInt64')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsingException::ParsingException<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000209f4f19 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadHelpers.cpp:92: DB::throwAtAssertionFailed(char const*, DB::ReadBuffer&) @ 0x00000000209adb77 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadHelpers.h:0: DB::TabSeparatedFormatReader::skipFieldDelimiter() @ 0x000000003ea53677 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Formats/RowInputFormatWithNamesAndTypes.cpp:0: DB::RowInputFormatWithNamesAndTypes::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003e492452 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/StorageS3.cpp:731: DB::StorageS3Source::generate() @ 0x000000003c32ec75 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:39.248896 [ 2415 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:39.280116 [ 4381 ] {9610d62e-6800-4ade-9ef4-6bd6d99ac15b} <Error> TCPHandler: Code: 27. DB::ParsingException: Cannot parse input: expected '\t' before: 'number\tname\n1\tClickHouse\n2\tHello\n3\tHedhehog\n': 
Row 1:
Column 0,   name: c1, type: UInt64, ERROR: text "number<TAB>nam" is not like UInt64

: While executing TabSeparatedRowInputFormat: While executing S3: (in file/uri test/tsv_with_header.tsv): (at row 1)
. (CANNOT_PARSE_INPUT_ASSERTION_FAILED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsingException::ParsingException<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000209f4f19 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadHelpers.cpp:92: DB::throwAtAssertionFailed(char const*, DB::ReadBuffer&) @ 0x00000000209adb77 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadHelpers.h:0: DB::TabSeparatedFormatReader::skipFieldDelimiter() @ 0x000000003ea53677 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Formats/RowInputFormatWithNamesAndTypes.cpp:0: DB::RowInputFormatWithNamesAndTypes::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003e492452 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/StorageS3.cpp:731: DB::StorageS3Source::generate() @ 0x000000003c32ec75 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:40.250471 [ 2467 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:41.254626 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:42.271726 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:42.325047 [ 3182 ] {e3acbe91-0b05-426a-9922-def2c175d2f2} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43258) (comment: 02366_explain_query_tree.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:42.333763 [ 3182 ] {e3acbe91-0b05-426a-9922-def2c175d2f2} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:43.261700 [ 3983 ] {64300bec-aa5f-47a4-999c-4183661c54cb} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00, current rows: 30.00: While executing Numbers. (TOO_MANY_ROWS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43292) (comment: 01132_max_rows_to_read.sql) (in query: SELECT count() FROM numbers(30);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:43.263723 [ 3983 ] {64300bec-aa5f-47a4-999c-4183661c54cb} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00, current rows: 30.00: While executing Numbers. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:43.285837 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:43.795909 [ 3983 ] {631df8ae-b223-427f-b0a4-fb1bf07b0255} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00, current rows: 21.00: While executing Numbers. (TOO_MANY_ROWS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43292) (comment: 01132_max_rows_to_read.sql) (in query: SELECT count() FROM numbers(21);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:43.798433 [ 3983 ] {631df8ae-b223-427f-b0a4-fb1bf07b0255} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00, current rows: 21.00: While executing Numbers. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:44.127941 [ 3983 ] {0d1888e5-d27d-4a05-8561-9b2ad74f882b} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00, current rows: 30.00: While executing Numbers. (TOO_MANY_ROWS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43292) (comment: 01132_max_rows_to_read.sql) (in query: -- check early exception if the estimated number of rows is high
 SELECT * FROM numbers(30);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:44.129335 [ 3983 ] {0d1888e5-d27d-4a05-8561-9b2ad74f882b} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00, current rows: 30.00: While executing Numbers. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000036ac78e2 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac7015 in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a73329 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:44.291265 [ 2459 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:45.295146 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:46.297306 [ 2372 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:47.299054 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:48.309040 [ 2376 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:49.311629 [ 2386 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:50.812316 [ 2345 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:50.812341 [ 3994 ] {206aeeb3-8de6-4e36-933a-8d6399e3078d} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toHour: while executing 'FUNCTION toHour(x1 :: 0) -> toHour(x1) UInt8 : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toHour(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeNumber<char8_t>, DB::ToHourImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToHourImpl const&) @ 0x000000001d1c414d in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeNumber<char8_t>, DB::ToHourImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d1c0de6 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:50.816957 [ 3994 ] {206aeeb3-8de6-4e36-933a-8d6399e3078d} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toHour: while executing 'FUNCTION toHour(x1 :: 0) -> toHour(x1) UInt8 : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeNumber<char8_t>, DB::ToHourImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToHourImpl const&) @ 0x000000001d1c414d in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeNumber<char8_t>, DB::ToHourImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d1c0de6 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:52.009826 [ 2443 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:52.009839 [ 3994 ] {e1674d29-b933-416d-baf5-bec4b7e9b5f7} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toMinute: while executing 'FUNCTION toMinute(x1 :: 0) -> toMinute(x1) UInt8 : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toMinute(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeNumber<char8_t>, DB::ToMinuteImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToMinuteImpl const&) @ 0x000000001d1ebe6d in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeNumber<char8_t>, DB::ToMinuteImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d1e89e6 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:52.011382 [ 3994 ] {e1674d29-b933-416d-baf5-bec4b7e9b5f7} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toMinute: while executing 'FUNCTION toMinute(x1 :: 0) -> toMinute(x1) UInt8 : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeNumber<char8_t>, DB::ToMinuteImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToMinuteImpl const&) @ 0x000000001d1ebe6d in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeNumber<char8_t>, DB::ToMinuteImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d1e89e6 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:53.272848 [ 3994 ] {95ea2dd0-0306-4b10-a564-5c94cb602b61} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toSecond: while executing 'FUNCTION toSecond(x1 :: 0) -> toSecond(x1) UInt8 : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toSecond(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeNumber<char8_t>, DB::ToSecondImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToSecondImpl const&) @ 0x000000001d25c22d in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeNumber<char8_t>, DB::ToSecondImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d258da6 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:53.274864 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:53.277965 [ 3994 ] {95ea2dd0-0306-4b10-a564-5c94cb602b61} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toSecond: while executing 'FUNCTION toSecond(x1 :: 0) -> toSecond(x1) UInt8 : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeNumber<char8_t>, DB::ToSecondImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToSecondImpl const&) @ 0x000000001d25c22d in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeNumber<char8_t>, DB::ToSecondImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d258da6 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:54.278588 [ 2397 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:55.946387 [ 3994 ] {a6c26b94-f0a5-41e9-b61c-c958faa571e8} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfSecond: while executing 'FUNCTION toStartOfSecond(x1 :: 0) -> toStartOfSecond(x1) DateTime64(3) : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toStartOfSecond(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime64, DB::ToStartOfSecondImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfSecondImpl const&) @ 0x000000001d2cf0e6 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeDateTime64, DB::ToStartOfSecondImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d2cd506 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:55.948395 [ 2458 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:55.955729 [ 3994 ] {a6c26b94-f0a5-41e9-b61c-c958faa571e8} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfSecond: while executing 'FUNCTION toStartOfSecond(x1 :: 0) -> toStartOfSecond(x1) DateTime64(3) : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime64, DB::ToStartOfSecondImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfSecondImpl const&) @ 0x000000001d2cf0e6 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeDateTime64, DB::ToStartOfSecondImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d2cd506 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:57.009241 [ 3994 ] {3f3346cf-cdf6-4153-9799-fdd86e7fb908} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfMinute: while executing 'FUNCTION toStartOfMinute(x1 :: 0) -> toStartOfMinute(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toStartOfMinute(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfMinuteImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfMinuteImpl const&) @ 0x000000001d2b0486 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfMinuteImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d2adaad in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:58.125411 [ 3994 ] {3f3346cf-cdf6-4153-9799-fdd86e7fb908} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfMinute: while executing 'FUNCTION toStartOfMinute(x1 :: 0) -> toStartOfMinute(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfMinuteImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfMinuteImpl const&) @ 0x000000001d2b0486 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfMinuteImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d2adaad in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:58.126929 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:58.130454 [ 3186 ] {9848e786-5617-4fdf-a6bb-6e2a68aed60e} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52688) (comment: 00173_group_by_use_nulls.sql) (in query: -- { echoOn }
 set allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:58.138209 [ 2860 ] {55a9b0ac-e5a9-4664-99be-ab8fe9b25175} <Error> executeQuery: Code: 43. DB::Exception: Second argument (weight) for function quantileExactWeighted must be unsigned integer, but it has type Float64. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:37426) (comment: 00831_quantile_weighted_parameter_check.sql) (in query: SELECT quantileExactWeighted(0.5)(number, 0.1) FROM numbers(10);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const* const&, String>(int, FormatStringHelperImpl<std::type_identity<char const* const&>::type, std::type_identity<String>::type>, char const* const&, String&&) @ 0x000000000ca10f79 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionQuantile.h:242: DB::AggregateFunctionQuantile<void, DB::QuantileExactWeighted<void>, DB::NameQuantileExactWeighted, true, void, false>::assertSecondArg(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) @ 0x0000000022fe02d1 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1467: std::shared_ptr<DB::IAggregateFunction const> DB::(anonymous namespace)::createAggregateFunctionQuantile<DB::(anonymous namespace)::FuncQuantileExactWeighted>(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000022fde243 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IAggregateFunction const> std::__function::__policy_invoker<std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IAggregateFunction const> (*)(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*), std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>>(std::__function::__policy_storage const*, String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000021359323 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035301e96 in /usr/bin/clickhouse
7. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:58.139885 [ 3186 ] {9848e786-5617-4fdf-a6bb-6e2a68aed60e} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:58.143583 [ 2860 ] {55a9b0ac-e5a9-4664-99be-ab8fe9b25175} <Error> TCPHandler: Code: 43. DB::Exception: Second argument (weight) for function quantileExactWeighted must be unsigned integer, but it has type Float64. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const* const&, String>(int, FormatStringHelperImpl<std::type_identity<char const* const&>::type, std::type_identity<String>::type>, char const* const&, String&&) @ 0x000000000ca10f79 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionQuantile.h:242: DB::AggregateFunctionQuantile<void, DB::QuantileExactWeighted<void>, DB::NameQuantileExactWeighted, true, void, false>::assertSecondArg(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) @ 0x0000000022fe02d1 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1467: std::shared_ptr<DB::IAggregateFunction const> DB::(anonymous namespace)::createAggregateFunctionQuantile<DB::(anonymous namespace)::FuncQuantileExactWeighted>(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000022fde243 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IAggregateFunction const> std::__function::__policy_invoker<std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IAggregateFunction const> (*)(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*), std::shared_ptr<DB::IAggregateFunction const> (String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*)>>(std::__function::__policy_storage const*, String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000021359323 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035301e96 in /usr/bin/clickhouse
7. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:59.565656 [ 2415 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:30:59.565814 [ 2759 ] {ca08fc9b-49b7-42c7-87ab-5edd1ec40ca2} <Error> executeQuery: Code: 48. DB::Exception: MergeJoinAlgorithm is not implemented for strictness Asof. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:37516) (comment: 00976_asof_join_on.sql) (in query: SELECT A.a, A.t, B.b, B.t FROM A ASOF LEFT JOIN B ON A.a == B.b AND A.t >= B.t ORDER BY (A.a, A.t);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<DB::JoinStrictness&>(int, FormatStringHelperImpl<std::type_identity<DB::JoinStrictness&>::type>, DB::JoinStrictness&) @ 0x000000003ebf236d in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/Transforms/MergeJoinTransform.cpp:294: DB::MergeJoinAlgorithm::MergeJoinAlgorithm(std::shared_ptr<DB::IJoin>, std::vector<DB::Block, std::allocator<DB::Block>> const&, unsigned long) @ 0x000000003ebdd080 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Merges/IMergingTransform.h:159: DB::MergeJoinTransform::MergeJoinTransform(std::shared_ptr<DB::IJoin>, std::vector<DB::Block, std::allocator<DB::Block>> const&, DB::Block const&, unsigned long, unsigned long) @ 0x000000003ebef5ef in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeJoinTransform> std::allocate_shared[abi:v15000]<DB::MergeJoinTransform, std::allocator<DB::MergeJoinTransform>, std::shared_ptr<DB::IJoin>&, std::vector<DB::Block, std::allocator<DB::Block>>&, DB::Block const&, unsigned long&, void>(std::allocator<DB::MergeJoinTransform> const&, std::shared_ptr<DB::IJoin>&, std::vector<DB::Block, std::allocator<DB::Block>>&, DB::Block const&, unsigned long&) @ 0x0000000036a61779 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::QueryPipelineBuilder::joinPipelinesYShaped(std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::shared_ptr<DB::IJoin>, DB::Block const&, unsigned long, std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>*) @ 0x0000000036a45aba in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:41: DB::JoinStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f13c65c in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:59.566163 [ 3994 ] {4ac8ac39-36f5-46af-a318-7b97863bb3a4} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfFiveMinutes: while executing 'FUNCTION toStartOfFiveMinutes(x1 :: 0) -> toStartOfFiveMinutes(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toStartOfFiveMinutes(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfFiveMinutesImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfFiveMinutesImpl const&) @ 0x000000001d27a0e6 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfFiveMinutesImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d27770d in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:59.571283 [ 3994 ] {4ac8ac39-36f5-46af-a318-7b97863bb3a4} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfFiveMinutes: while executing 'FUNCTION toStartOfFiveMinutes(x1 :: 0) -> toStartOfFiveMinutes(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfFiveMinutesImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfFiveMinutesImpl const&) @ 0x000000001d27a0e6 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfFiveMinutesImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d27770d in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:30:59.576245 [ 2759 ] {ca08fc9b-49b7-42c7-87ab-5edd1ec40ca2} <Error> TCPHandler: Code: 48. DB::Exception: MergeJoinAlgorithm is not implemented for strictness Asof. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<DB::JoinStrictness&>(int, FormatStringHelperImpl<std::type_identity<DB::JoinStrictness&>::type>, DB::JoinStrictness&) @ 0x000000003ebf236d in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/Transforms/MergeJoinTransform.cpp:294: DB::MergeJoinAlgorithm::MergeJoinAlgorithm(std::shared_ptr<DB::IJoin>, std::vector<DB::Block, std::allocator<DB::Block>> const&, unsigned long) @ 0x000000003ebdd080 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Merges/IMergingTransform.h:159: DB::MergeJoinTransform::MergeJoinTransform(std::shared_ptr<DB::IJoin>, std::vector<DB::Block, std::allocator<DB::Block>> const&, DB::Block const&, unsigned long, unsigned long) @ 0x000000003ebef5ef in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeJoinTransform> std::allocate_shared[abi:v15000]<DB::MergeJoinTransform, std::allocator<DB::MergeJoinTransform>, std::shared_ptr<DB::IJoin>&, std::vector<DB::Block, std::allocator<DB::Block>>&, DB::Block const&, unsigned long&, void>(std::allocator<DB::MergeJoinTransform> const&, std::shared_ptr<DB::IJoin>&, std::vector<DB::Block, std::allocator<DB::Block>>&, DB::Block const&, unsigned long&) @ 0x0000000036a61779 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::QueryPipelineBuilder::joinPipelinesYShaped(std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::shared_ptr<DB::IJoin>, DB::Block const&, unsigned long, std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>*) @ 0x0000000036a45aba in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:41: DB::JoinStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f13c65c in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:00.530788 [ 3994 ] {54f55a0c-f79d-4346-a48c-4d196fcd0e67} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfTenMinutes: while executing 'FUNCTION toStartOfTenMinutes(x1 :: 0) -> toStartOfTenMinutes(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toStartOfTenMinutes(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfTenMinutesImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfTenMinutesImpl const&) @ 0x000000001d2ebd66 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfTenMinutesImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d2e938d in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:01.821639 [ 3994 ] {54f55a0c-f79d-4346-a48c-4d196fcd0e67} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfTenMinutes: while executing 'FUNCTION toStartOfTenMinutes(x1 :: 0) -> toStartOfTenMinutes(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfTenMinutesImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfTenMinutesImpl const&) @ 0x000000001d2ebd66 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfTenMinutesImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d2e938d in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:01.822823 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:01.830190 [ 2759 ] {e9fe0be9-700c-483b-bdc8-f5abca140366} <Error> executeQuery: Code: 50. DB::Exception: Unknown BSON type: 0x00: While executing BSONEachRowRowInputFormat. (UNKNOWN_TYPE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:37558) (comment: 02684_bson.sql) (in query: -- It correctly throws exception about incorrect data:
 SELECT * FROM format('BSONEachRow', 'WatchID Int64, JavaEnable Int16, Title String, GoodEvent Int16, EventTime DateTime, EventDate Date, CounterID Int32, ClientIP Int32, RegionID Int32, UserID Int64, CounterClass Int16, OS Int16, UserAgent Int16, URL String, Referer String, IsRefresh Int16, RefererCategoryID Int16, RefererRegionID Int32, URLCategoryID Int16, URLRegionID Int32, ResolutionWidth Int16, ResolutionHeight Int16, ResolutionDepth Int16, FlashMajor Int16, FlashMinor Int16, FlashMinor2 String, NetMajor Int16, NetMinor Int16, UserAgentMajor Int16, UserAgentMinor String, CookieEnable Int16, JavascriptEnable Int16, IsMobile Int16, MobilePhone Int16, MobilePhoneModel String, Params String, IPNetworkID Int32, TraficSourceID Int16, SearchEngineID Int16, SearchPhrase String, AdvEngineID Int16, IsArtifical Int16, WindowClientWidth Int16, WindowClientHeight Int16, ClientTimeZone Int16, ClientEventTime DateTime, SilverlightVersion1 Int16, SilverlightVersion2 Int16, SilverlightVersion3 Int32, SilverlightVersion4 Int16, PageCharset String, CodeVersion Int32, IsLink Int16, IsDownload Int16, IsNotBounce Int16, FUniqID Int64, OriginalURL String, HID Int32, IsOldCounter Int16, IsEvent Int16, IsParameter Int16, DontCountHits Int16, WithHash Int16, HitColor String, LocalEventTime DateTime, Age Int16, Sex Int16, Income Int16, Interests Int16, Robotness Int16, RemoteIP Int32, WindowName Int32, OpenerName Int32, HistoryLength Int16, BrowserLanguage String, BrowserCountry String, SocialNetwork String, SocialAction String, HTTPError Int16, SendTiming Int32, DNSTiming Int32, ConnectTiming Int32, ResponseStartTiming Int32, ResponseEndTiming Int32, FetchTiming Int32, SocialSourceNetworkID Int16, SocialSourcePage String, ParamPrice Int64, ParamOrderID String, ParamCurrency String, ParamCurrencyID Int16, OpenstatServiceName String, OpenstatCampaignID String, OpenstatAdID String, OpenstatSourceID String, UTMSource String, UTMMedium String, UTMCampaign String, UTMContent String, UTMTerm String, FromTag String, HasGCLID Int16, RefererHash Int64, URLHash Int64, CLID Int32', $$^WatchIDc*5/ !p~JavaEnableTitleGoodEvent
EventTime7��QEventDate>CounterIDClientIP��z�RegionIDGUserID� ��:6��CounterClassOSUserAgentURLRefererIsRefreshRefererCategoryIDRefererRegionIDURLCategoryIDURLRegionIDResolutionWidthResolutionHeightResolutionDepthFlashMajorFlashMinorFlashMinor2NetMajorNetMinorUserAgentMajorUserAgentMinor�OCookieEnableJavascriptEnableIsMobileMobilePhoneMobilePhoneModelParamsIPNetworkID��9TraficSourceIDSearchEngineIDSearchPhraseAdvEngineIDIsArtificalWindowClientWidthWindowClientHeightClientTimeZone����ClientEventTime��
SilverlightVersion1SilverlightVersion2SilverlightVersion3SilverlightVersion4PageCharsetCodeVersionIsLinkIsDownloadIsNotBounceFUniqIDOriginalURLHIDIsOldCounterIsEventIsParameterDontCountHitsWithHashHitColor
5LocalEventTime&��QAgeSexIncomeInterestsRobotnessRemoteIP^DI�WindowName����OpenerName����HistoryLength����BrowserLanguage�BrowserCountry�SocialNetworkSocialActionHTTPErrorSendTimingDNSTimingConnectTimingResponseStartTimingResponseEndTimingFetchTimingSocialSourceNetworkIDSocialSourcePageParamPriceParamOrderIDParamCurrencyNHParamCurrencyIDOpenstatServiceNameOpenstatCampaignIDOpenstatAdIDOpenstatSourceIDUTMSourceUTMMediumUTMCampaignUTMContentUTMTermFromTagHasGCLIDRefererHashX+��'���URLHash�|3��b.�CLID^WatchID��F�ӓ2qJavaEnableTitleGoodEvent
EventTimen$�QEventDate>CounterIDClientIP��z�RegionIDGUserID� ��:6��CounterClassOSUserAgentURLRefererIsRefreshRefererCategoryIDRefererRegionIDURLCategoryIDURLRegionIDResolutionWidthResolutionHeightResolutionDepthmingResponseStartTimingResponseEndTimingFetchTimingSocialSourceNetworkIDSocialSourcePageParamPriceParamOrderIDParamCurrencyNHParamCurrencyIDOpenstatServiceNameOpenstatCampaignIDOpenstatAdIDOpenstatSourceIDUTMSourceUTMMediumUTMCampaignUTMContentUTMTermFromTagHasGCLIDRefererHashX+��'���URLHashv�v
����CLID�WatchID���\JavaEnableTitleGoodEvent
EventTime� �QEventDate>CounterIDClientIP�gURegionID�UserID�s�yy��fCounterClassOS,UserAgentURL1http://tours/Ekategoriya%2F&sr=http://slovareniyeRefererIsRefreshRefererCategoryIDRefererRegionIDURLCategoryIDURLRegionID�ResolutionWidthResolutionHeightResolutionDepthFlashMajorFlashMinorFlashMinor2NetMajorNetMinorUserAgentMajor	UserAgentMinorD�CookieEnableJavascriptEnableIsMobileMobilePhoneMobilePhoneModelParamsIPNetworkID��TraficSourceIDSearchEngineIDSearchPhraseAdvEngineIDIsArtificalWindowClientWidthWindowClientHeightClientTimeZone����ClientEventTime��
SilverlightVersion1SilverlightVersion2SilverlightVersion3SilverlightVersion4PageCharsetCodeVersionIsLinkIsDownloadIsNotBounceFUniqIDOriginalURLHIDIsOldCounterIsEventIsParameterDontCountHitsWithHashHitColor
5LocalEventTimeY��QAgeSexIncomeInterestsRobotnessRemoteIP�=kWindowName����OpenerName����HistoryLength����BrowserLanguage�BrowserCountry�SocialNetworkSocialActionHTTPErrorSendTimingDNSTimingConnectTimingResponseStartTimingResponseEndTimingFetchTimingSocialSourceNetworkIDSocialSourcePageParamPriceParamOrderIDParamCurrencyNHParamCurrencyIDOpenstatServiceNameOpenstatCampaignIDOpenstatAdIDOpenstatSourceIDUTMSourceUTMMediumUTMCampaignUTMContentUTMTermFromTagHasGCLIDRefererHashX+��'���URLHashh��9�DCLID^WatchID�/E��J�{JavaEnableTitleGoodEvent
EventTime�1�QEventDate>CounterIDClientIP��z�RegionIDGUserID� ��:6��CounterClassOSUserAgentURLRefererIsRefreshRefererCategoryIDRefererRegionIDURLCategoryIDURLRegionIDResolutionWidthResolutionHeightResolutionDepthFlashMajorFlashMinorFlashMinor2NetMajorNetMinorUserAgentMajorUserAgentMinor�OCookieEnableJavascriptEnableIsMobileMobilePhoneMobilePhoneModelParamsIPNetworkID��9TraficSourceIDSearchEngineIDSearchPhraseAdvEngineIDIsArtificalWindowClientWidthWindowClientHeightClientTimeZone����ClientEventTime��
SilverlightVersion1SilverlightVersion2SilverlightVersion3SilverlightVersion4PageCharsetCodeVersionIsLinkIsDownloadIsNotBounceFUniqIDOriginalURLHIDIsOldCounterIsEventIsParameterDontCountHitsWithHashHitColor
5LocalEventTime���QAgeSexIncomeInterestsRobotnessRemoteIP^DI�WindowName����OpenerName����HistoryLength����BrowserLanguage�BrowserCountry�SocialNetworkSocialActionHTTPErrorSendTimingDNSTimingConnectTimingResponseStartTimingResponseEndTimingFetchTimingSocialSourceNetworkIDSocialSourcePageParamPriceParamOrderIDParamCurrencyNHParamCurrencyIDOpenstatServiceNameOpenstatCampaignIDOpenstatAdIDOpenstatSourceIDUTMSourceUTMMediumUTMCampaignUTMContentUTMTermFromTagHasGCLIDRefererHashX+��'���URLHash�|3��b.�CLID$$);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Formats/BSONTypes.cpp:23: DB::getBSONType(unsigned char) @ 0x000000003e426ea6 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Formats/Impl/BSONEachRowRowInputFormat.cpp:0: DB::BSONEachRowRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003e416ccb in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
13. ./build_docker/./src/TableFunctions/TableFunctionFormat.cpp:0: DB::TableFunctionFormat::parseData(DB::ColumnsDescription, std::shared_ptr<DB::Context const>) const @ 0x0000000034b08679 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/ColumnsDescription.h:101: DB::TableFunctionFormat::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x0000000034b0a144 in /usr/bin/clickhouse
15. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:31:01.838882 [ 2759 ] {e9fe0be9-700c-483b-bdc8-f5abca140366} <Error> TCPHandler: Code: 50. DB::Exception: Unknown BSON type: 0x00: While executing BSONEachRowRowInputFormat. (UNKNOWN_TYPE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Formats/BSONTypes.cpp:23: DB::getBSONType(unsigned char) @ 0x000000003e426ea6 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Formats/Impl/BSONEachRowRowInputFormat.cpp:0: DB::BSONEachRowRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000003e416ccb in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x000000003e3c4f2c in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
13. ./build_docker/./src/TableFunctions/TableFunctionFormat.cpp:0: DB::TableFunctionFormat::parseData(DB::ColumnsDescription, std::shared_ptr<DB::Context const>) const @ 0x0000000034b08679 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/ColumnsDescription.h:101: DB::TableFunctionFormat::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x0000000034b0a144 in /usr/bin/clickhouse
15. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:31:02.469646 [ 3994 ] {12a9f528-e8a4-470b-b2bb-a2f649e439ba} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfFifteenMinutes: while executing 'FUNCTION toStartOfFifteenMinutes(x1 :: 0) -> toStartOfFifteenMinutes(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toStartOfFifteenMinutes(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfFifteenMinutesImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfFifteenMinutesImpl const&) @ 0x000000001d26fba6 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfFifteenMinutesImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d26d1cd in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:02.474989 [ 3994 ] {12a9f528-e8a4-470b-b2bb-a2f649e439ba} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfFifteenMinutes: while executing 'FUNCTION toStartOfFifteenMinutes(x1 :: 0) -> toStartOfFifteenMinutes(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfFifteenMinutesImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfFifteenMinutesImpl const&) @ 0x000000001d26fba6 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfFifteenMinutesImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d26d1cd in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:03.954014 [ 3994 ] {cbb8e191-5a7f-4c53-a355-75b9fe4f4de0} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfHour: while executing 'FUNCTION toStartOfHour(x1 :: 0) -> toStartOfHour(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toStartOfHour(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfHourImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfHourImpl const&) @ 0x000000001d2843e6 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfHourImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d281a0d in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:03.957353 [ 2394 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:03.957686 [ 3994 ] {cbb8e191-5a7f-4c53-a355-75b9fe4f4de0} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toStartOfHour: while executing 'FUNCTION toStartOfHour(x1 :: 0) -> toStartOfHour(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToStartOfHourImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToStartOfHourImpl const&) @ 0x000000001d2843e6 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToDateTimeOrDateTime64<DB::ToStartOfHourImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d281a0d in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:04.960179 [ 2352 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:06.777198 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:06.777217 [ 3994 ] {b4854bc4-ec1c-47b9-baab-89672e507b00} <Error> executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for function toTime: while executing 'FUNCTION toTime(x1 :: 0) -> toTime(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40244) (comment: 01921_datatype_date32.sql) (in query: select toTime(x1) from t1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToTimeImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToTimeImpl const&) @ 0x000000001d301826 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeDateTime, DB::ToTimeImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d2fe546 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:06.786323 [ 3994 ] {b4854bc4-ec1c-47b9-baab-89672e507b00} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for function toTime: while executing 'FUNCTION toTime(x1 :: 0) -> toTime(x1) DateTime : 1'. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const*&>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type>, char const*&) @ 0x000000000a710378 in /usr/bin/clickhouse
3. DB::throwDateTimeIsNotSupported(char const*) @ 0x000000000a70ff0b in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::DateTimeTransformImpl<DB::DataTypeDate32, DB::DataTypeDateTime, DB::ToTimeImpl, false>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, DB::ToTimeImpl const&) @ 0x000000001d301826 in /usr/bin/clickhouse
5. DB::FunctionDateOrDateTimeToSomething<DB::DataTypeDateTime, DB::ToTimeImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001d2fe546 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:07.777878 [ 2353 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:08.842353 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:09.847097 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:10.847693 [ 2450 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:11.864334 [ 2425 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:12.874698 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:13.875538 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:14.878426 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:15.898351 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:16.905486 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:17.910317 [ 2413 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:18.963650 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:19.982375 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:20.984574 [ 2389 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:21.990303 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:23.016553 [ 2407 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:24.032712 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:25.062815 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:26.063496 [ 2388 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:27.082135 [ 2450 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:28.086830 [ 2376 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:31.397940 [ 3139 ] {6ba0415f-1cca-438c-a407-a2597f251688} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1891007 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column RefererRegions): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43262) (comment: 00167_read_bytes_from_fs.sql) (in query: SELECT sum(cityHash64(*)) FROM test.hits SETTINGS max_threads=40;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:251: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed692d in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:31:32.232158 [ 6637 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:35.979930 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 5144438 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f47322 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:37.701312 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 4194949 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
7. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.h:159: DB::ReverseIndex<unsigned long, DB::ColumnString>::insert(StringRef) @ 0x0000000036b50819 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/ColumnUnique.h:0: COW<DB::IColumn>::mutable_ptr<DB::IColumn> DB::ColumnUnique<DB::ColumnString>::uniqueInsertRangeImpl<char8_t>(DB::IColumn const&, unsigned long, unsigned long, unsigned long, DB::ColumnVector<char8_t>::MutablePtr&&, DB::ReverseIndex<unsigned long, DB::ColumnString>*, unsigned long) @ 0x0000000036b488be in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: COW<DB::IColumn>::mutable_ptr<DB::IColumn> DB::ColumnUnique<DB::ColumnString>::uniqueInsertRangeFrom(DB::IColumn const&, unsigned long, unsigned long)::'lambda'(auto)::operator()<char8_t>(auto) const @ 0x0000000036b46cf1 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnUnique.h:0: DB::ColumnUnique<DB::ColumnString>::uniqueInsertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x0000000036b41c5c in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::Dictionary::compact(DB::IColumnUnique const&, COW<DB::IColumn>::mutable_ptr<DB::IColumn>&) @ 0x000000003b1002a7 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::cutAndCompact(unsigned long, unsigned long) const @ 0x000000003b0ffde6 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::SerializeBinaryBulkState>&) const @ 0x0000000036f4af9e in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:147: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123257 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000003d124c95 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:422: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000003d1274e5 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d6640e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:39.780013 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/jhb/skpoolygxlhgxblsddtlximexfiuh, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id a738fbc1-8ded-48d7-8f97-c3803ec637de, upload has finished false.
2024.09.24 02:31:39.780121 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/jhb/skpoolygxlhgxblsddtlximexfiuh, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id a738fbc1-8ded-48d7-8f97-c3803ec637de, upload has finished false
2024.09.24 02:31:39.816132 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/jhb/skpoolygxlhgxblsddtlximexfiuh, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id a738fbc1-8ded-48d7-8f97-c3803ec637de, upload has finished false
2024.09.24 02:31:39.844921 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/blx/yygognbdiforzjhmzqrgotarhuxwv, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 2281ae0b-06c0-4c27-a209-67de59f30ecb, upload has finished false.
2024.09.24 02:31:39.845057 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/blx/yygognbdiforzjhmzqrgotarhuxwv, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 2281ae0b-06c0-4c27-a209-67de59f30ecb, upload has finished false
2024.09.24 02:31:39.863300 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/blx/yygognbdiforzjhmzqrgotarhuxwv, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 2281ae0b-06c0-4c27-a209-67de59f30ecb, upload has finished false
2024.09.24 02:31:39.925095 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/jtp/knuuidrvyhcxinphfykfamivkylju, total size 49592685, count 49592685, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 35327c94-0d18-4b99-81d1-5260d7f5ce14, upload has finished false.
2024.09.24 02:31:39.925198 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/jtp/knuuidrvyhcxinphfykfamivkylju, total size 49592685, count 49592685, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 35327c94-0d18-4b99-81d1-5260d7f5ce14, upload has finished false
2024.09.24 02:31:39.943864 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/jtp/knuuidrvyhcxinphfykfamivkylju, total size 49592685, count 49592685, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 35327c94-0d18-4b99-81d1-5260d7f5ce14, upload has finished false
2024.09.24 02:31:40.838628 [ 3989 ] {8b6d7287-c47f-4a29-b307-d929f6fba668} <Error> executeQuery: Code: 36. DB::Exception: Cannot determine the file format by it's extension. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:45826) (comment: 02724_database_s3.sh) (in query: SELECT * FROM "http://localhost:11111/test/a.myext" ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [51]>(int, char const (&) [51]) @ 0x00000000093c5e37 in /usr/bin/clickhouse
3. ./build_docker/./src/Formats/FormatFactory.cpp:631: DB::FormatFactory::getFormatFromFileName(String, bool) @ 0x000000003e13296f in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::TableFunctionS3::parseArgumentsImpl(absl::lts_20211102::InlinedVector<std::shared_ptr<DB::IAST>, 7ul, std::allocator<std::shared_ptr<DB::IAST>>>&, std::shared_ptr<DB::Context const> const&) @ 0x0000000034a7f390 in /usr/bin/clickhouse
5. ./build_docker/./src/TableFunctions/TableFunctionS3.cpp:196: DB::TableFunctionS3::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x0000000034a81c2a in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseS3.cpp:128: DB::DatabaseS3::getTableImpl(String const&, std::shared_ptr<DB::Context const>) const @ 0x00000000394e104d in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseS3.cpp:143: DB::DatabaseS3::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x00000000394e3049 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:43.013137 [ 2438 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:43.013276 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 4194487 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const*, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const*) @ 0x000000003b3d8270 in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>::clone() const @ 0x000000003b425026 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)::operator()(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) const @ 0x000000000a9cddbe in /usr/bin/clickhouse
11. void std::__function::__policy_invoker<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>::__call_impl<std::__function::__default_alloc_func<DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&), void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>>(std::__function::__policy_storage const*, COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) @ 0x000000000a9cdca9 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::ColumnTuple::forEachSubcolumn(std::function<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>) @ 0x000000003b2543ad in /usr/bin/clickhouse
13. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cda63 in /usr/bin/clickhouse
14. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4b81f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:44.174895 [ 2582 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 4559817 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:45.754959 [ 2861 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:45.755434 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 4295106 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:45.755632 [ 3983 ] {507007ce-2ad0-4773-a65d-b63517ec6244} <Error> executeQuery: Code: 584. DB::Exception: No projection is used when optimize_use_projections = 1 and force_optimize_projection = 1. (PROJECTION_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:45718) (comment: 01710_projections.sql) (in query: select * from projection_test;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [90]>(int, char const (&) [90]) @ 0x000000000f03ff17 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:0: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31dc50 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:45.755680 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ea37678b-8afe-4455-ab95-2e8eb662fcd1::202409_1_36_7}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:45.760682 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_41_8}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1939964 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:47.058438 [ 3981 ] {c6e19bac-193b-441e-9c4f-72e560a4bba2} <Error> executeQuery: Code: 36. DB::Exception: Function reverseDNSQuery requires the input column to be of type String: While processing reverseDNSQuery(1). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43486) (comment: 02483_test_reverse_dns_resolution.sql) (in query: -- Expect error, invalid column type
 select reverseDNSQuery(1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const* const&>(int, FormatStringHelperImpl<std::type_identity<char const* const&>::type>, char const* const&) @ 0x0000000009487b58 in /usr/bin/clickhouse
3. DB::ReverseDNSQuery::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001ccef4df in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:31:47.529552 [ 3139 ] {6ba0415f-1cca-438c-a407-a2597f251688} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/tdr/fhblynutaebbperdjitgwoayjpeqo, hash key: e83af39f48d7d40929d7e0637f8e7b5e, file_offset_of_buffer_end: 0, read_until_position: 2795, internal buffer end: 7142, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6ba0415f-1cca-438c-a407-a2597f251688:6110, file segment info: File segment: [0, 7141], key: e83af39f48d7d40929d7e0637f8e7b5e, state: DOWNLOADING, downloaded size: 0, reserved size: 7142, downloader id: 6ba0415f-1cca-438c-a407-a2597f251688:6110, current write offset: 0, caller id: 6ba0415f-1cca-438c-a407-a2597f251688:6110, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
23. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.544093 [ 3989 ] {8b6d7287-c47f-4a29-b307-d929f6fba668} <Error> TCPHandler: Code: 36. DB::Exception: Cannot determine the file format by it's extension. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [51]>(int, char const (&) [51]) @ 0x00000000093c5e37 in /usr/bin/clickhouse
3. ./build_docker/./src/Formats/FormatFactory.cpp:631: DB::FormatFactory::getFormatFromFileName(String, bool) @ 0x000000003e13296f in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::TableFunctionS3::parseArgumentsImpl(absl::lts_20211102::InlinedVector<std::shared_ptr<DB::IAST>, 7ul, std::allocator<std::shared_ptr<DB::IAST>>>&, std::shared_ptr<DB::Context const> const&) @ 0x0000000034a7f390 in /usr/bin/clickhouse
5. ./build_docker/./src/TableFunctions/TableFunctionS3.cpp:196: DB::TableFunctionS3::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x0000000034a81c2a in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseS3.cpp:128: DB::DatabaseS3::getTableImpl(String const&, std::shared_ptr<DB::Context const>) const @ 0x00000000394e104d in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseS3.cpp:143: DB::DatabaseS3::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x00000000394e3049 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:48.544185 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 2228255 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:56: DB::MergedColumnOnlyOutputStream::write(DB::Block const&) @ 0x000000003d679929 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForOneColumn() const @ 0x000000003cddd3d8 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:842: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::VerticalMergeStage::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8ed8 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000003cde562e in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.544229 [ 3983 ] {507007ce-2ad0-4773-a65d-b63517ec6244} <Error> TCPHandler: Code: 584. DB::Exception: No projection is used when optimize_use_projections = 1 and force_optimize_projection = 1. (PROJECTION_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [90]>(int, char const (&) [90]) @ 0x000000000f03ff17 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:0: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31dc50 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:48.544171 [ 2759 ] {20fa90a1-c367-4953-9a7b-b24ebc677b7c} <Error> executeQuery: Code: 69. DB::Exception: A call to function range would produce 18446744073709550590 array elements, which is greater than the allowed maximum of 500000000: While processing range(1025, 18446744073709551615, 1). (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34046) (comment: 01408_range_overflow.sql) (in query: SELECT range(1025, 18446744073709551615, 1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000947c83e in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionRange::executeGeneric<unsigned long>(DB::IColumn const*, DB::IColumn const*, DB::IColumn const*, unsigned long) const @ 0x0000000020732792 in /usr/bin/clickhouse
4. DB::FunctionRange::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000206f432c in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:31:48.544317 [ 3981 ] {c6e19bac-193b-441e-9c4f-72e560a4bba2} <Error> TCPHandler: Code: 36. DB::Exception: Function reverseDNSQuery requires the input column to be of type String: While processing reverseDNSQuery(1). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const* const&>(int, FormatStringHelperImpl<std::type_identity<char const* const&>::type>, char const* const&) @ 0x0000000009487b58 in /usr/bin/clickhouse
3. DB::ReverseDNSQuery::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001ccef4df in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:31:48.548511 [ 3186 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.548514 [ 2394 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.555676 [ 2751 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.557305 [ 2759 ] {20fa90a1-c367-4953-9a7b-b24ebc677b7c} <Error> TCPHandler: Code: 69. DB::Exception: A call to function range would produce 18446744073709550590 array elements, which is greater than the allowed maximum of 500000000: While processing range(1025, 18446744073709551615, 1). (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000947c83e in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionRange::executeGeneric<unsigned long>(DB::IColumn const*, DB::IColumn const*, DB::IColumn const*, unsigned long) const @ 0x0000000020732792 in /usr/bin/clickhouse
4. DB::FunctionRange::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000206f432c in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:31:48.557766 [ 3154 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.560309 [ 2950 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.562802 [ 3207 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.564634 [ 6603 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.567265 [ 3992 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.571106 [ 2905 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.572108 [ 6601 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.572692 [ 3994 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:48.607295 [ 3981 ] {93feb697-6b51-41e8-a1da-3add41a2d846} <Error> executeQuery: Code: 42. DB::Exception: Number of arguments for function reverseDNSQuery doesn't match: passed 0, should be 1: While processing reverseDNSQuery(). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43486) (comment: 02483_test_reverse_dns_resolution.sql) (in query: -- Expect error, wrong number of arguments
 select reverseDNSQuery();), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002d09e090 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x00000000352c9c0d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352caf9f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:31:48.616070 [ 3981 ] {93feb697-6b51-41e8-a1da-3add41a2d846} <Error> TCPHandler: Code: 42. DB::Exception: Number of arguments for function reverseDNSQuery doesn't match: passed 0, should be 1: While processing reverseDNSQuery(). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002d09e090 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x00000000352c9c0d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352caf9f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:31:48.733805 [ 3981 ] {b8d1f3fe-039a-4167-94ac-fc87d688c5c0} <Error> executeQuery: Code: 42. DB::Exception: Number of arguments for function reverseDNSQuery doesn't match: passed 2, should be 1: While processing reverseDNSQuery(1, 2). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43486) (comment: 02483_test_reverse_dns_resolution.sql) (in query: select reverseDNSQuery(1, 2);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002d09e090 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x00000000352c9c0d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352caf9f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:31:48.740833 [ 3981 ] {b8d1f3fe-039a-4167-94ac-fc87d688c5c0} <Error> TCPHandler: Code: 42. DB::Exception: Number of arguments for function reverseDNSQuery doesn't match: passed 2, should be 1: While processing reverseDNSQuery(1, 2). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002d09e090 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x00000000352c9c0d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352caf9f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:31:49.410504 [ 3139 ] {6ba0415f-1cca-438c-a407-a2597f251688} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048807 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/gdt/mpgzuvuodnkhcoglcvqlhortokgze, hash key: 8b0795d3b5cf46a561ff4c5968cd61da, file_offset_of_buffer_end: 14553, read_until_position: 16746, internal buffer end: 23999, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6ba0415f-1cca-438c-a407-a2597f251688:3339, file segment info: File segment: [0, 23998], key: 8b0795d3b5cf46a561ff4c5968cd61da, state: DOWNLOADING, downloaded size: 0, reserved size: 14553, downloader id: 6ba0415f-1cca-438c-a407-a2597f251688:3339, current write offset: 0, caller id: 6ba0415f-1cca-438c-a407-a2597f251688:3339, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:50.877125 [ 3976 ] {80c62742-426a-46c3-bb10-ca97da86b777} <Error> executeQuery: Code: 36. DB::Exception: Host is empty in S3 URI. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47804) (comment: 02724_database_s3.sh) (in query: SELECT * FROM "abacaba" ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [25]>(int, char const (&) [25]) @ 0x000000000a764057 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/S3/URI.cpp:49: DB::S3::URI::URI(String const&) @ 0x0000000034aa1c88 in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseS3.cpp:0: DB::DatabaseS3::checkUrl(String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x00000000394df1d9 in /usr/bin/clickhouse
5. ./build_docker/./src/Databases/DatabaseS3.cpp:0: DB::DatabaseS3::getTableImpl(String const&, std::shared_ptr<DB::Context const>) const @ 0x00000000394dfeb0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseS3.cpp:143: DB::DatabaseS3::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x00000000394e3049 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:50.878665 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:50.878735 [ 3990 ] {b3e63fba-0bb2-4754-b0db-bfe836ef7298} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47814) (comment: 02366_explain_query_tree.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:50.878864 [ 3139 ] {6ba0415f-1cca-438c-a407-a2597f251688} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048807 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/jcm/etghmbzjnblrboifgxdiylrunodji, hash key: 841afcee731f97a08f56d2f94fa97476, file_offset_of_buffer_end: 20524, read_until_position: 24391, internal buffer end: 33231, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6ba0415f-1cca-438c-a407-a2597f251688:2998, file segment info: File segment: [0, 33230], key: 841afcee731f97a08f56d2f94fa97476, state: DOWNLOADING, downloaded size: 0, reserved size: 20524, downloader id: 6ba0415f-1cca-438c-a407-a2597f251688:2998, current write offset: 0, caller id: 6ba0415f-1cca-438c-a407-a2597f251688:2998, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:50.878665 [ 3983 ] {535bb085-50c6-4f6a-9ade-1e5f1947ba1b} <Error> executeQuery: Code: 584. DB::Exception: No projection is used when optimize_use_projections = 1 and force_optimize_projection = 1. (PROJECTION_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:45718) (comment: 01710_projections.sql) (in query: select toStartOfMinute(datetime) dt_m, countIf(first_time = 0) from projection_test join (select 1) x on 1 where domain = '1' group by dt_m order by dt_m;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [90]>(int, char const (&) [90]) @ 0x000000000f03ff17 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:0: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31dc50 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:50.881213 [ 3983 ] {535bb085-50c6-4f6a-9ade-1e5f1947ba1b} <Error> TCPHandler: Code: 584. DB::Exception: No projection is used when optimize_use_projections = 1 and force_optimize_projection = 1. (PROJECTION_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [90]>(int, char const (&) [90]) @ 0x000000000f03ff17 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:0: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31dc50 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:50.881765 [ 3990 ] {b3e63fba-0bb2-4754-b0db-bfe836ef7298} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:50.900548 [ 3976 ] {80c62742-426a-46c3-bb10-ca97da86b777} <Error> TCPHandler: Code: 36. DB::Exception: Host is empty in S3 URI. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [25]>(int, char const (&) [25]) @ 0x000000000a764057 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/S3/URI.cpp:49: DB::S3::URI::URI(String const&) @ 0x0000000034aa1c88 in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseS3.cpp:0: DB::DatabaseS3::checkUrl(String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x00000000394df1d9 in /usr/bin/clickhouse
5. ./build_docker/./src/Databases/DatabaseS3.cpp:0: DB::DatabaseS3::getTableImpl(String const&, std::shared_ptr<DB::Context const>) const @ 0x00000000394dfeb0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseS3.cpp:143: DB::DatabaseS3::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x00000000394e3049 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:31:50.911186 [ 3139 ] {6ba0415f-1cca-438c-a407-a2597f251688} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048807 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/yoe/amjcuyfuaedumtmmkehcsvckzuqlj, hash key: f5aca6ad2c96d3f24eda27036a1dee24, file_offset_of_buffer_end: 18178, read_until_position: 33336, internal buffer end: 33336, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6ba0415f-1cca-438c-a407-a2597f251688:3354, file segment info: File segment: [0, 33335], key: f5aca6ad2c96d3f24eda27036a1dee24, state: DOWNLOADING, downloaded size: 0, reserved size: 18178, downloader id: 6ba0415f-1cca-438c-a407-a2597f251688:3354, current write offset: 0, caller id: 6ba0415f-1cca-438c-a407-a2597f251688:3354, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:51.880229 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:52.551375 [ 3139 ] {6ba0415f-1cca-438c-a407-a2597f251688} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1891007 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column RefererRegions): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:251: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed692d in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:31:52.889469 [ 2438 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:54.010385 [ 2395 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:54.011390 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_40_60_4}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x000000002089312c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000002088e69d in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x00000000207ac6df in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ThreadFuzzer.cpp:242: DB::ThreadFuzzer::maybeInjectMemoryLimitException() @ 0x00000000209420d6 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003dacefcf in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc15 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:55.056643 [ 2357 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:56.095587 [ 2384 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:57.133279 [ 2333 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:58.171369 [ 2325 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:31:59.213390 [ 2381 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:00.230463 [ 2403 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:01.251977 [ 2441 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:02.266673 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:03.299088 [ 2460 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:04.308187 [ 2413 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:05.322118 [ 2462 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:06.339024 [ 2366 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:08.282694 [ 2317 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:08.282706 [ 6603 ] {da454ec9-d7ff-4614-9653-ae730030fd5b} <Error> executeQuery: Code: 57. DB::Exception: Table test_1.url already exists. (TABLE_ALREADY_EXISTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41850) (comment: 02184_table_engine_access.sh) (in query: CREATE TABLE url ENGINE=URL('https://clickhouse.com', LineAsString)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String, String>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&, String&&, String&&) @ 0x000000002c44d17e in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1349: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393fbbad in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:08.288329 [ 6603 ] {da454ec9-d7ff-4614-9653-ae730030fd5b} <Error> TCPHandler: Code: 57. DB::Exception: Table test_1.url already exists. (TABLE_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String, String>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&, String&&, String&&) @ 0x000000002c44d17e in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1349: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393fbbad in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:10.226659 [ 6601 ] {5e596b92-9885-4cba-ae69-3b9ee02853f2} <Error> executeQuery: Code: 497. DB::Exception: user_test_02184: Not enough privileges. To execute this query, it's necessary to have the grant URL ON *.*. (ACCESS_DENIED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41938) (comment: 02184_table_engine_access.sh) (in query: CREATE TABLE t AS url), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/ContextAccess.cpp:520: auto bool DB::ContextAccess::checkAccessImplHelper<true, false>(DB::AccessFlags) const::'lambda'<typename ...$T>(int, FormatStringHelperImpl<String, std::type_identity<$T>::type...>, $T&&...)::operator()<String>(int, FormatStringHelperImpl<String, std::type_identity<$T>::type...>, $T&&...) const @ 0x0000000035b69c93 in /usr/bin/clickhouse
4. ./build_docker/./src/Access/ContextAccess.cpp:560: bool DB::ContextAccess::checkAccessImplHelper<true, false>(DB::AccessFlags) const @ 0x0000000035b678b1 in /usr/bin/clickhouse
5. ./build_docker/./src/Access/ContextAccess.cpp:698: DB::ContextAccess::checkAccess(DB::AccessFlags const&) const @ 0x0000000035b044c6 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1200: DB::Context::checkAccess(DB::AccessFlags const&) const @ 0x000000003789e1b2 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b2f58 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:10.230857 [ 2433 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:10.260276 [ 6601 ] {5e596b92-9885-4cba-ae69-3b9ee02853f2} <Error> TCPHandler: Code: 497. DB::Exception: user_test_02184: Not enough privileges. To execute this query, it's necessary to have the grant URL ON *.*. (ACCESS_DENIED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/ContextAccess.cpp:520: auto bool DB::ContextAccess::checkAccessImplHelper<true, false>(DB::AccessFlags) const::'lambda'<typename ...$T>(int, FormatStringHelperImpl<String, std::type_identity<$T>::type...>, $T&&...)::operator()<String>(int, FormatStringHelperImpl<String, std::type_identity<$T>::type...>, $T&&...) const @ 0x0000000035b69c93 in /usr/bin/clickhouse
4. ./build_docker/./src/Access/ContextAccess.cpp:560: bool DB::ContextAccess::checkAccessImplHelper<true, false>(DB::AccessFlags) const @ 0x0000000035b678b1 in /usr/bin/clickhouse
5. ./build_docker/./src/Access/ContextAccess.cpp:698: DB::ContextAccess::checkAccess(DB::AccessFlags const&) const @ 0x0000000035b044c6 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1200: DB::Context::checkAccess(DB::AccessFlags const&) const @ 0x000000003789e1b2 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b2f58 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:11.238957 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:12.275209 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:13.302742 [ 2466 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:14.320703 [ 2331 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:15.323226 [ 2347 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:16.338993 [ 2366 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:17.367505 [ 2352 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:18.378913 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:19.417287 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:20.419171 [ 2443 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:21.421195 [ 2461 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:22.429084 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:23.438880 [ 2331 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:24.440284 [ 2340 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:25.445665 [ 2385 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:26.447129 [ 2317 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:27.448395 [ 2360 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:28.456008 [ 2369 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:29.458833 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:29.997497 [ 2860 ] {311d92ec-e85f-4c97-a8d1-06a21aa5037d} <Warning> DatabaseReplicated (test_mcg5vhuo): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments
2024.09.24 02:32:30.027067 [ 2860 ] {311d92ec-e85f-4c97-a8d1-06a21aa5037d} <Error> executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40194) (comment: 01213_alter_rename_primary_key_zookeeper_long.sql) (in query: CREATE TABLE table_for_rename_pk (`date` Date, `key1` UInt64, `key2` UInt64, `key3` UInt64, `value1` String, `value2` String) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{database}/test_01213/table_for_rename_pk1', '1') PARTITION BY date ORDER BY (key1, pow(key2, 2), key3) SETTINGS index_granularity = 13092, min_bytes_for_wide_part = 851815671, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 10407, prefer_fetch_merged_part_size_threshold = 8227578575, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 7321291375, index_granularity_bytes = 24980065, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 41266, primary_key_compress_block_size = 59758), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:30.040147 [ 2860 ] {311d92ec-e85f-4c97-a8d1-06a21aa5037d} <Error> TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [211]>(int, char const (&) [211]) @ 0x0000000037196037 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003714f9cf in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037150bdc in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:30.470509 [ 2466 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:32.228076 [ 3151 ] {a7cc17f1-6f96-4e4c-ab55-8453729e2353} <Error> executeQuery: Code: 119. DB::Exception: Table engine is not specified in CREATE query. (ENGINE_REQUIRED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE TABLE table_02184 (x UInt8);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [46]>(int, char const (&) [46]) @ 0x000000000a75abd7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:916: DB::(anonymous namespace)::setDefaultTableEngine(DB::ASTStorage&, DB::DefaultTableEngine) @ 0x00000000393c6ca7 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x00000000393c0746 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:673: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b2cf8 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:33.708982 [ 3151 ] {a7cc17f1-6f96-4e4c-ab55-8453729e2353} <Error> TCPHandler: Code: 119. DB::Exception: Table engine is not specified in CREATE query. (ENGINE_REQUIRED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [46]>(int, char const (&) [46]) @ 0x000000000a75abd7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:916: DB::(anonymous namespace)::setDefaultTableEngine(DB::ASTStorage&, DB::DefaultTableEngine) @ 0x00000000393c6ca7 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x00000000393c0746 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:673: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b2cf8 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:33.709053 [ 3101 ] {a8d0a0dd-530f-45fd-8eeb-f72811ab3d93} <Error> executeQuery: Code: 53. DB::Exception: Type mismatch in IN or VALUES section. Expected: UInt8. Got: Tuple: While processing (1, 2) IN ((1, (2, 3)), (1 + 1, 1)). (TYPE_MISMATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40212) (comment: 01421_assert_in_in.sql) (in query: SELECT (1, 2) IN ((1, (2, 3)), (1 + 1, 1));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, DB::Field::Types::Which>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<DB::Field::Types::Which>::type>, String&&, DB::Field::Types::Which&&) @ 0x000000003a90c415 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/convertFieldToType.cpp:81: DB::Field DB::(anonymous namespace)::convertNumericType<char8_t>(DB::Field const&, DB::IDataType const&) @ 0x000000003a8eb3a0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/convertFieldToType.cpp:0: DB::(anonymous namespace)::convertFieldToTypeImpl(DB::Field const&, DB::IDataType const&, DB::IDataType const*) @ 0x000000003a8e1297 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/convertFieldToType.cpp:0: DB::convertFieldToType(DB::Field const&, DB::IDataType const&, DB::IDataType const*) @ 0x000000003a8e03c9 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:261: DB::makeExplicitSet(DB::ASTFunction const*, DB::ActionsDAG const&, std::shared_ptr<DB::Context const>, DB::PreparedSets&) @ 0x0000000037d3b4f5 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:1443: DB::ActionsMatcher::makeSet(DB::ASTFunction const&, DB::ActionsMatcher::Data&, bool) @ 0x0000000037d6dc7c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4ad4e in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:32:33.709019 [ 3987 ] {} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000035e1bd4e in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1904: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x00000000378b8175 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x000000003e0df937 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x000000003e0bf4be in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:33.711068 [ 2401 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:33.723785 [ 3101 ] {a8d0a0dd-530f-45fd-8eeb-f72811ab3d93} <Error> TCPHandler: Code: 53. DB::Exception: Type mismatch in IN or VALUES section. Expected: UInt8. Got: Tuple: While processing (1, 2) IN ((1, (2, 3)), (1 + 1, 1)). (TYPE_MISMATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, DB::Field::Types::Which>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<DB::Field::Types::Which>::type>, String&&, DB::Field::Types::Which&&) @ 0x000000003a90c415 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/convertFieldToType.cpp:81: DB::Field DB::(anonymous namespace)::convertNumericType<char8_t>(DB::Field const&, DB::IDataType const&) @ 0x000000003a8eb3a0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/convertFieldToType.cpp:0: DB::(anonymous namespace)::convertFieldToTypeImpl(DB::Field const&, DB::IDataType const&, DB::IDataType const*) @ 0x000000003a8e1297 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/convertFieldToType.cpp:0: DB::convertFieldToType(DB::Field const&, DB::IDataType const&, DB::IDataType const*) @ 0x000000003a8e03c9 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:261: DB::makeExplicitSet(DB::ASTFunction const*, DB::ActionsDAG const&, std::shared_ptr<DB::Context const>, DB::PreparedSets&) @ 0x0000000037d3b4f5 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:1443: DB::ActionsMatcher::makeSet(DB::ASTFunction const&, DB::ActionsMatcher::Data&, bool) @ 0x0000000037d6dc7c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4ad4e in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:32:34.715087 [ 2386 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:36.485587 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:36.485637 [ 3151 ] {4ecbb3fa-6963-42e6-8db0-62d4ff91485b} <Error> executeQuery: Code: 42. DB::Exception: ORDER BY or PRIMARY KEY clause is missing. Consider using extended storage definition syntax with ORDER BY or PRIMARY KEY clause. With deprecated old syntax (highly not recommended) storage MergeTree requires 3 to 4 parameters: 
name of column with date,
[sampling element of primary key],
primary key expression,
index granularity

Syntax for the MergeTree table engine:

CREATE TABLE [IF NOT EXISTS] [db.]table_name [ON CLUSTER cluster]
(
    name1 [type1] [DEFAULT|MATERIALIZED|ALIAS expr1] [TTL expr1],
    name2 [type2] [DEFAULT|MATERIALIZED|ALIAS expr2] [TTL expr2],
    ...
    INDEX index_name1 expr1 TYPE type1(...) [GRANULARITY value1],
    INDEX index_name2 expr2 TYPE type2(...) [GRANULARITY value2]
) ENGINE = MergeTree()
ORDER BY expr
[PARTITION BY expr]
[PRIMARY KEY expr]
[SAMPLE BY expr]
[TTL expr [DELETE|TO DISK 'xxx'|TO VOLUME 'xxx'], ...]
[SETTINGS name=value, ...]

See details in documentation: https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/. Other engines of the family support different syntax, see details in the corresponding documentation topics.

If you use the Replicated version of engines, see https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/replication/.
. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02184_default_table_engine.sql) (in query: /* ddl_entry=query-0000000004 */ CREATE TABLE test_bqd46a6w.table_02184 UUID 'cf62ced7-e1a3-4c72-bb37-85c5e9e593fb' (`x` UInt8) ENGINE = MergeTree), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, String&, char const* const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String&>::type, std::type_identity<char const* const&>::type>, String const&, String&, char const* const&) @ 0x000000003da1259a in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0c282 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:36.511804 [ 3151 ] {4ecbb3fa-6963-42e6-8db0-62d4ff91485b} <Error> executeQuery: Code: 42. DB::Exception: ORDER BY or PRIMARY KEY clause is missing. Consider using extended storage definition syntax with ORDER BY or PRIMARY KEY clause. With deprecated old syntax (highly not recommended) storage MergeTree requires 3 to 4 parameters: 
name of column with date,
[sampling element of primary key],
primary key expression,
index granularity

Syntax for the MergeTree table engine:

CREATE TABLE [IF NOT EXISTS] [db.]table_name [ON CLUSTER cluster]
(
    name1 [type1] [DEFAULT|MATERIALIZED|ALIAS expr1] [TTL expr1],
    name2 [type2] [DEFAULT|MATERIALIZED|ALIAS expr2] [TTL expr2],
    ...
    INDEX index_name1 expr1 TYPE type1(...) [GRANULARITY value1],
    INDEX index_name2 expr2 TYPE type2(...) [GRANULARITY value2]
) ENGINE = MergeTree()
ORDER BY expr
[PARTITION BY expr]
[PRIMARY KEY expr]
[SAMPLE BY expr]
[TTL expr [DELETE|TO DISK 'xxx'|TO VOLUME 'xxx'], ...]
[SETTINGS name=value, ...]

See details in documentation: https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/. Other engines of the family support different syntax, see details in the corresponding documentation topics.

If you use the Replicated version of engines, see https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/replication/.
. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE TABLE table_02184 (x UInt8);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, String&, char const* const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String&>::type, std::type_identity<char const* const&>::type>, String const&, String&, char const* const&) @ 0x000000003da1259a in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0c282 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:36.523826 [ 3151 ] {4ecbb3fa-6963-42e6-8db0-62d4ff91485b} <Error> TCPHandler: Code: 42. DB::Exception: ORDER BY or PRIMARY KEY clause is missing. Consider using extended storage definition syntax with ORDER BY or PRIMARY KEY clause. With deprecated old syntax (highly not recommended) storage MergeTree requires 3 to 4 parameters: 
name of column with date,
[sampling element of primary key],
primary key expression,
index granularity

Syntax for the MergeTree table engine:

CREATE TABLE [IF NOT EXISTS] [db.]table_name [ON CLUSTER cluster]
(
    name1 [type1] [DEFAULT|MATERIALIZED|ALIAS expr1] [TTL expr1],
    name2 [type2] [DEFAULT|MATERIALIZED|ALIAS expr2] [TTL expr2],
    ...
    INDEX index_name1 expr1 TYPE type1(...) [GRANULARITY value1],
    INDEX index_name2 expr2 TYPE type2(...) [GRANULARITY value2]
) ENGINE = MergeTree()
ORDER BY expr
[PARTITION BY expr]
[PRIMARY KEY expr]
[SAMPLE BY expr]
[TTL expr [DELETE|TO DISK 'xxx'|TO VOLUME 'xxx'], ...]
[SETTINGS name=value, ...]

See details in documentation: https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/. Other engines of the family support different syntax, see details in the corresponding documentation topics.

If you use the Replicated version of engines, see https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/replication/.
. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, String&, char const* const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String&>::type, std::type_identity<char const* const&>::type>, String const&, String&, char const* const&) @ 0x000000003da1259a in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0c282 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:37.487534 [ 2441 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:39.906986 [ 3151 ] {9a80bb14-a0bc-4602-adc8-df2d70b806f0} <Error> executeQuery: Code: 36. DB::Exception: You must provide an ORDER BY or PRIMARY KEY expression in the table definition. If you don't want this table to be sorted, use ORDER BY/PRIMARY KEY (). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02184_default_table_engine.sql) (in query: /* ddl_entry=query-0000000009 */ CREATE TABLE test_bqd46a6w.table_02184 UUID '956a246e-bf40-4367-a3b0-1c843e6a4d1f' (`x` UInt8) ENGINE = MergeTree PARTITION BY x), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [151]>(int, char const (&) [151]) @ 0x000000003940af57 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:537: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0b3db in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:39.907753 [ 2391 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:40.050340 [ 3151 ] {9a80bb14-a0bc-4602-adc8-df2d70b806f0} <Error> executeQuery: Code: 36. DB::Exception: You must provide an ORDER BY or PRIMARY KEY expression in the table definition. If you don't want this table to be sorted, use ORDER BY/PRIMARY KEY (). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE TABLE table_02184 (x UInt8) PARTITION BY x;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [151]>(int, char const (&) [151]) @ 0x000000003940af57 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:537: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0b3db in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:40.053331 [ 3151 ] {9a80bb14-a0bc-4602-adc8-df2d70b806f0} <Error> TCPHandler: Code: 36. DB::Exception: You must provide an ORDER BY or PRIMARY KEY expression in the table definition. If you don't want this table to be sorted, use ORDER BY/PRIMARY KEY (). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [151]>(int, char const (&) [151]) @ 0x000000003940af57 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:537: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0b3db in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:40.916175 [ 2339 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:41.917484 [ 2343 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:46.278827 [ 3239 ] {5dde8293-2fdd-48ca-b35e-1902c3bbfc97} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:45904) (comment: 00169_contingency.sql) (in query: WITH URLDomain AS a, RefererDomain AS b SELECT round(cramersV(a, b), 2), round(cramersVBiasCorrected(a, b), 2), round(theilsU(a, b), 2), round(theilsU(b, a), 2), round(contingency(a, b), 2) FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:46.278928 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1141669 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column Hits): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_2_2_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6553): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:612: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForOneColumn() const @ 0x000000003cddd35f in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:842: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::VerticalMergeStage::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8ed8 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:46.279626 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:48.364873 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_40_66_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1060000 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned int, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned int const*, unsigned int const*) @ 0x00000000208b878c in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<unsigned int>>::clone() const @ 0x000000003b422926 in /usr/bin/clickhouse
11. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
12. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:48.364877 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:48.367680 [ 3239 ] {5dde8293-2fdd-48ca-b35e-1902c3bbfc97} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:48.961379 [ 3101 ] {a2df7b5f-ce91-42c7-9647-db73b1746c77} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 0.00 B (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55966) (comment: 02302_clash_const_aggegate_join.sql) (in query: SELECT sumIf( 1, if( 1, toDateTime('2020-01-01 00:00:00', 'UTC'), toDateTime('1970-01-01 00:00:00', 'UTC')) > t ) FROM e JOIN ( SELECT 1 joinKey) AS da ON joinKey = a WHERE t >= toDateTime('2021-07-19T13:00:00', 'UTC') AND t <= toDateTime('2021-07-19T13:59:59', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037de8d88 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/Stopwatch.h:68: DB::AggregatingTransform::initGenerate() @ 0x000000003eb128da in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12284 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
15. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:48.961535 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_1_43_8}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1050750 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:72: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f86a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:49.047259 [ 3101 ] {a2df7b5f-ce91-42c7-9647-db73b1746c77} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 0.00 B (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037de8d88 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/Stopwatch.h:68: DB::AggregatingTransform::initGenerate() @ 0x000000003eb128da in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12284 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
15. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:49.367490 [ 2368 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:50.368214 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:51.426317 [ 2751 ] {35df7702-f515-4e2b-a617-5975bfb2fa4e} <Error> executeQuery: Code: 184. DB::Exception: Nested identical combinator 'If' is not supported. (ILLEGAL_AGGREGATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39202) (comment: 02025_nested_func_for_if_combinator.sql) (in query: SELECT uniqCombinedIfMergeIf(n, last > 50) FILTER(WHERE last>50) FROM (SELECT uniqCombinedIfState(number, number % 2) AS n, max(number) AS last FROM numbers(10));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:191: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035302986 in /usr/bin/clickhouse
4. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:51.426708 [ 2331 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:51.430831 [ 3982 ] {133f438c-f47e-4f44-8abd-7f652b502f22} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 83.29 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53928) (comment: 00077_log_tinylog_stripelog.sql) (in query: SELECT count(), sum(cityHash64(*)) FROM test.hits_log;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:51.439441 [ 2751 ] {35df7702-f515-4e2b-a617-5975bfb2fa4e} <Error> TCPHandler: Code: 184. DB::Exception: Nested identical combinator 'If' is not supported. (ILLEGAL_AGGREGATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:191: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035302986 in /usr/bin/clickhouse
4. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:52.414077 [ 3982 ] {133f438c-f47e-4f44-8abd-7f652b502f22} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 83.29 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:52.431616 [ 2392 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:52.615480 [ 2751 ] {70049e34-43cd-4c8e-ba83-0c7362af01cf} <Error> executeQuery: Code: 184. DB::Exception: Nested identical combinator 'If' is not supported. (ILLEGAL_AGGREGATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39202) (comment: 02025_nested_func_for_if_combinator.sql) (in query: SELECT uniqCombinedIfMergeIfIf(n, last > 5) FROM (SELECT uniqCombinedIfState(number, number % 2) AS n, max(number) AS last FROM numbers(10));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:191: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035302986 in /usr/bin/clickhouse
4. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:52.629977 [ 2751 ] {70049e34-43cd-4c8e-ba83-0c7362af01cf} <Error> TCPHandler: Code: 184. DB::Exception: Nested identical combinator 'If' is not supported. (ILLEGAL_AGGREGATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:191: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035302986 in /usr/bin/clickhouse
4. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:52.810503 [ 2751 ] {c6f6cda2-13e8-4645-b8a6-6de402c75323} <Error> executeQuery: Code: 184. DB::Exception: Nested identical combinator 'If' is not supported. (ILLEGAL_AGGREGATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39202) (comment: 02025_nested_func_for_if_combinator.sql) (in query: SELECT uniqCombinedIfMergeIfIf(n, last > 5, 1) FROM (SELECT uniqCombinedIfState(number, number % 2) AS n, max(number) AS last FROM numbers(10));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:191: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035302986 in /usr/bin/clickhouse
4. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:52.919393 [ 2751 ] {c6f6cda2-13e8-4645-b8a6-6de402c75323} <Error> TCPHandler: Code: 184. DB::Exception: Nested identical combinator 'If' is not supported. (ILLEGAL_AGGREGATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:191: DB::AggregateFunctionFactory::getImpl(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x0000000035302986 in /usr/bin/clickhouse
4. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:113: DB::AggregateFunctionFactory::get(String const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000352fc59d in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:582: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr<DB::ActionsDAG>&, std::vector<DB::AggregateDescription, std::allocator<DB::AggregateDescription>>&) @ 0x0000000037ca8a5b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037c9cba0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, unsigned long, bool, bool, std::shared_ptr<DB::PreparedSets>, bool) @ 0x0000000037c9902d in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:322: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::TreeRewriterResult const> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<String, std::allocator<String>> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b91eed in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:674: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3da81 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:53.527287 [ 2390 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:54.538922 [ 2412 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:55.458764 [ 2751 ] {b18f6762-8dbc-4d69-b293-45a474591a73} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53086) (comment: 02377_analyzer_in_function_set.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:55.469614 [ 2751 ] {b18f6762-8dbc-4d69-b293-45a474591a73} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:55.578072 [ 2403 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:56.593179 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:57.949606 [ 2459 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:57.949763 [ 3151 ] {735dea1d-b75b-4978-87b8-27b48d1788eb} <Error> executeQuery: Code: 80. DB::Exception: Database engine must be specified. (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE DATABASE test_02184 ORDER BY kek;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [34]>(int, char const (&) [34]) @ 0x000000000a76ccb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x00000000393963c8 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:57.953417 [ 3151 ] {735dea1d-b75b-4978-87b8-27b48d1788eb} <Error> TCPHandler: Code: 80. DB::Exception: Database engine must be specified. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [34]>(int, char const (&) [34]) @ 0x000000000a76ccb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x00000000393963c8 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:58.827950 [ 3151 ] {805cf37b-db99-4ab6-bc18-f4c8080da960} <Error> executeQuery: Code: 115. DB::Exception: Setting x is neither a builtin setting nor started with the prefix 'SQL_' or 'custom_' registered for user-defined settings. (UNKNOWN_SETTING) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE DATABASE test_02184 SETTINGS x=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/AccessControl.cpp:132: DB::AccessControl::CustomSettingsPrefixes::checkSettingNameIsAllowed(std::basic_string_view<char, std::char_traits<char>>) const @ 0x0000000035a6829d in /usr/bin/clickhouse
4. ./build_docker/./src/Access/AccessControl.cpp:649: DB::AccessControl::checkSettingNameIsAllowed(std::basic_string_view<char, std::char_traits<char>>) const @ 0x0000000035a64e26 in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b25c in /usr/bin/clickhouse
6. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:0: DB::InterpreterSetQuery::executeForCurrentContext(bool) @ 0x0000000039d96a79 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:0: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x0000000039d978a7 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a998da3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:58.829200 [ 3151 ] {805cf37b-db99-4ab6-bc18-f4c8080da960} <Error> TCPHandler: Code: 115. DB::Exception: Setting x is neither a builtin setting nor started with the prefix 'SQL_' or 'custom_' registered for user-defined settings. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/AccessControl.cpp:132: DB::AccessControl::CustomSettingsPrefixes::checkSettingNameIsAllowed(std::basic_string_view<char, std::char_traits<char>>) const @ 0x0000000035a6829d in /usr/bin/clickhouse
4. ./build_docker/./src/Access/AccessControl.cpp:649: DB::AccessControl::checkSettingNameIsAllowed(std::basic_string_view<char, std::char_traits<char>>) const @ 0x0000000035a64e26 in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b25c in /usr/bin/clickhouse
6. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:0: DB::InterpreterSetQuery::executeForCurrentContext(bool) @ 0x0000000039d96a79 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:0: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x0000000039d978a7 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a998da3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:32:58.954803 [ 2464 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:32:59.956227 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:01.766435 [ 3981 ] {9157a91a-426b-4094-b88b-95b664514071} <Error> executeQuery: Code: 70. DB::Exception: Conversion from IntervalDay to Decimal(10, 10) is not supported: While processing CAST(toIntervalDay(1), 'Nullable(Decimal(10, 10))'). (CANNOT_CONVERT_TYPE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53176) (comment: 00879_cast_to_decimal_crash.sql) (in query: select cast(toIntervalDay(1) as Nullable(Decimal(10, 10)));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. std::function<COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)> DB::FunctionCast<DB::CastName>::createDecimalWrapper<DB::DataTypeDecimal<DB::Decimal<long>>>(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeDecimal<DB::Decimal<long>> const*, bool) const @ 0x000000000a56efde in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<void, DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const::'lambda'(auto const&)&>(DB::TypeIndex, DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const::'lambda'(auto const&)&) @ 0x000000000a29895f in /usr/bin/clickhouse
5. DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x000000000a293b92 in /usr/bin/clickhouse
6. DB::FunctionCast<DB::CastName>::prepareRemoveNullable(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x000000000a2906a2 in /usr/bin/clickhouse
7. DB::FunctionCast<DB::CastName>::prepareUnpackDictionaries(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&) const @ 0x000000000a28f8e0 in /usr/bin/clickhouse
8. DB::FunctionCast<DB::CastName>::prepare(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a28ea3f in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d8ece in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:33:01.770614 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:01.777646 [ 3981 ] {9157a91a-426b-4094-b88b-95b664514071} <Error> TCPHandler: Code: 70. DB::Exception: Conversion from IntervalDay to Decimal(10, 10) is not supported: While processing CAST(toIntervalDay(1), 'Nullable(Decimal(10, 10))'). (CANNOT_CONVERT_TYPE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. std::function<COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)> DB::FunctionCast<DB::CastName>::createDecimalWrapper<DB::DataTypeDecimal<DB::Decimal<long>>>(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeDecimal<DB::Decimal<long>> const*, bool) const @ 0x000000000a56efde in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<void, DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const::'lambda'(auto const&)&>(DB::TypeIndex, DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const::'lambda'(auto const&)&) @ 0x000000000a29895f in /usr/bin/clickhouse
5. DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x000000000a293b92 in /usr/bin/clickhouse
6. DB::FunctionCast<DB::CastName>::prepareRemoveNullable(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x000000000a2906a2 in /usr/bin/clickhouse
7. DB::FunctionCast<DB::CastName>::prepareUnpackDictionaries(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&) const @ 0x000000000a28f8e0 in /usr/bin/clickhouse
8. DB::FunctionCast<DB::CastName>::prepare(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000a28ea3f in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d8ece in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse

2024.09.24 02:33:02.776766 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:04.015459 [ 3981 ] {1115687a-699c-461b-a635-fcf079fc4a2f} <Error> executeQuery: Code: 48. DB::Exception: Truncate is not supported by storage View. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53212) (comment: 00623_truncate_table_throw_exception.sh) (in query: TRUNCATE TABLE test_truncate.test_view;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/IStorage.h:452: DB::IStorage::truncate(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, DB::TableExclusiveLockHolder&) @ 0x0000000034b59375 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x00000000396494a3 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x0000000039645727 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643b20 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:04.025867 [ 3981 ] {1115687a-699c-461b-a635-fcf079fc4a2f} <Error> TCPHandler: Code: 48. DB::Exception: Truncate is not supported by storage View. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/IStorage.h:452: DB::IStorage::truncate(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, DB::TableExclusiveLockHolder&) @ 0x0000000034b59375 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x00000000396494a3 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x0000000039645727 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643b20 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:04.143178 [ 2440 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:04.679478 [ 6601 ] {9a036b22-2ba6-4935-89d7-1dcc99ff0d35} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 314.13 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39274) (comment: 00078_group_by_arrays.sql) (in query: SELECT GeneralInterests AS k1, GoalsReached AS k2, count() AS c FROM test.hits GROUP BY k1, k2 ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:04.797681 [ 3983 ] {aaf80eea-76f2-49d7-abdd-0ce966124130} <Error> executeQuery: Code: 48. DB::Exception: Can't execute FULL_SORTING_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53192) (comment: 02277_full_sort_join_misc.sql) (in query: SELECT * FROM (SELECT 1 as key) AS t1 JOIN (SELECT 1 as key) t2 USING key ORDER BY key;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:04.804578 [ 3983 ] {aaf80eea-76f2-49d7-abdd-0ce966124130} <Error> TCPHandler: Code: 48. DB::Exception: Can't execute FULL_SORTING_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:06.047041 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:06.047028 [ 3151 ] {761a7c97-68de-4837-953e-fa883def3ea8} <Error> executeQuery: Code: 36. DB::Exception: Engine Memory doesn't support PARTITION_BY, PRIMARY_KEY, ORDER_BY or SAMPLE_BY clauses. Currently only the following engines have support for the feature: [AzureBlobStorage, KeeperMap, S3Queue, HDFS, MaterializedPostgreSQL, S3, ReplicatedVersionedCollapsingMergeTree, OSS, ReplicatedSummingMergeTree, COSN, Redis, MergeTree, ReplicatedReplacingMergeTree, VersionedCollapsingMergeTree, Hive, ReplacingMergeTree, ReplicatedAggregatingMergeTree, ReplicatedMergeTree, EmbeddedRocksDB, ReplicatedCollapsingMergeTree, ReplicatedGraphiteMergeTree, SummingMergeTree, GraphiteMergeTree, CollapsingMergeTree, AggregatingMergeTree]. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE TEMPORARY TABLE tmp2 (n int) ORDER BY n;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String&, String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, String&, String&, String&) @ 0x0000000020afaf7e in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFactory.cpp:171: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const::$_0::operator()(String, std::function<bool (DB::StorageFactory::StorageFeatures)>) const @ 0x000000003bc0cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageFactory.cpp:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0a847 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageID const&)>::__call_impl<std::__function::__default_alloc_func<DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&)::$_0, std::shared_ptr<DB::IStorage> (DB::StorageID const&)>>(std::__function::__policy_storage const*, DB::StorageID const&) @ 0x00000000394099db in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:110: DB::TemporaryTableHolder::TemporaryTableHolder(std::shared_ptr<DB::Context const>, std::function<std::shared_ptr<DB::IStorage> (DB::StorageID const&)> const&, std::shared_ptr<DB::IAST> const&) @ 0x0000000037ac4164 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f1838 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:06.904783 [ 6601 ] {9a036b22-2ba6-4935-89d7-1dcc99ff0d35} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 314.13 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:06.904819 [ 6599 ] {9de30093-72fc-4d09-8715-a4683b1deb17} <Error> executeQuery: Code: 558. DB::Exception: Expected ALL or DISTINCT in SelectWithUnion query, because setting (union_default_mode) is empty: While processing SELECT 1 UNION SELECT 1 UNION ALL SELECT 1. (EXPECTED_ALL_OR_DISTINCT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43360) (comment: 01732_union_and_union_all.sql) (in query: select 1 UNION select 1 UNION ALL select 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [97]>(int, char const (&) [97]) @ 0x00000000094903b7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/NormalizeSelectWithUnionQueryVisitor.cpp:74: DB::NormalizeSelectWithUnionQueryMatcher::visit(DB::ASTSelectWithUnionQuery&, DB::NormalizeSelectWithUnionQueryMatcher::Data&) @ 0x000000003a9d2d27 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/NormalizeSelectWithUnionQueryVisitor.cpp:0: DB::NormalizeSelectWithUnionQueryMatcher::visit(std::shared_ptr<DB::IAST>&, DB::NormalizeSelectWithUnionQueryMatcher::Data&) @ 0x000000003a9cf779 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::NormalizeSelectWithUnionQueryMatcher, false, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x000000003a9bf1d5 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:807: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a999dc5 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:06.904772 [ 3151 ] {761a7c97-68de-4837-953e-fa883def3ea8} <Error> TCPHandler: Code: 36. DB::Exception: Engine Memory doesn't support PARTITION_BY, PRIMARY_KEY, ORDER_BY or SAMPLE_BY clauses. Currently only the following engines have support for the feature: [AzureBlobStorage, KeeperMap, S3Queue, HDFS, MaterializedPostgreSQL, S3, ReplicatedVersionedCollapsingMergeTree, OSS, ReplicatedSummingMergeTree, COSN, Redis, MergeTree, ReplicatedReplacingMergeTree, VersionedCollapsingMergeTree, Hive, ReplacingMergeTree, ReplicatedAggregatingMergeTree, ReplicatedMergeTree, EmbeddedRocksDB, ReplicatedCollapsingMergeTree, ReplicatedGraphiteMergeTree, SummingMergeTree, GraphiteMergeTree, CollapsingMergeTree, AggregatingMergeTree]. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String&, String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, String&, String&, String&) @ 0x0000000020afaf7e in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFactory.cpp:171: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const::$_0::operator()(String, std::function<bool (DB::StorageFactory::StorageFeatures)>) const @ 0x000000003bc0cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageFactory.cpp:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0a847 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageID const&)>::__call_impl<std::__function::__default_alloc_func<DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&)::$_0, std::shared_ptr<DB::IStorage> (DB::StorageID const&)>>(std::__function::__policy_storage const*, DB::StorageID const&) @ 0x00000000394099db in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:110: DB::TemporaryTableHolder::TemporaryTableHolder(std::shared_ptr<DB::Context const>, std::function<std::shared_ptr<DB::IStorage> (DB::StorageID const&)> const&, std::shared_ptr<DB::IAST> const&) @ 0x0000000037ac4164 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f1838 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:06.905899 [ 6599 ] {9de30093-72fc-4d09-8715-a4683b1deb17} <Error> TCPHandler: Code: 558. DB::Exception: Expected ALL or DISTINCT in SelectWithUnion query, because setting (union_default_mode) is empty: While processing SELECT 1 UNION SELECT 1 UNION ALL SELECT 1. (EXPECTED_ALL_OR_DISTINCT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [97]>(int, char const (&) [97]) @ 0x00000000094903b7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/NormalizeSelectWithUnionQueryVisitor.cpp:74: DB::NormalizeSelectWithUnionQueryMatcher::visit(DB::ASTSelectWithUnionQuery&, DB::NormalizeSelectWithUnionQueryMatcher::Data&) @ 0x000000003a9d2d27 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/NormalizeSelectWithUnionQueryVisitor.cpp:0: DB::NormalizeSelectWithUnionQueryMatcher::visit(std::shared_ptr<DB::IAST>&, DB::NormalizeSelectWithUnionQueryMatcher::Data&) @ 0x000000003a9cf779 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::NormalizeSelectWithUnionQueryMatcher, false, false, std::shared_ptr<DB::IAST>>::doVisit(std::shared_ptr<DB::IAST>&) @ 0x000000003a9bf1d5 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:807: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a999dc5 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:06.921264 [ 3151 ] {a3bc26bc-7012-4bb7-be77-25123000f457} <Error> executeQuery: Code: 36. DB::Exception: Engine Memory doesn't support PARTITION_BY, PRIMARY_KEY, ORDER_BY or SAMPLE_BY clauses. Currently only the following engines have support for the feature: [AzureBlobStorage, KeeperMap, S3Queue, HDFS, MaterializedPostgreSQL, S3, ReplicatedVersionedCollapsingMergeTree, OSS, ReplicatedSummingMergeTree, COSN, Redis, MergeTree, ReplicatedReplacingMergeTree, VersionedCollapsingMergeTree, Hive, ReplacingMergeTree, ReplicatedAggregatingMergeTree, ReplicatedMergeTree, EmbeddedRocksDB, ReplicatedCollapsingMergeTree, ReplicatedGraphiteMergeTree, SummingMergeTree, GraphiteMergeTree, CollapsingMergeTree, AggregatingMergeTree]. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE TEMPORARY TABLE tmp2 (n int, PRIMARY KEY (n));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String&, String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, String&, String&, String&) @ 0x0000000020afaf7e in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFactory.cpp:171: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const::$_0::operator()(String, std::function<bool (DB::StorageFactory::StorageFeatures)>) const @ 0x000000003bc0cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageFactory.cpp:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0a847 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageID const&)>::__call_impl<std::__function::__default_alloc_func<DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&)::$_0, std::shared_ptr<DB::IStorage> (DB::StorageID const&)>>(std::__function::__policy_storage const*, DB::StorageID const&) @ 0x00000000394099db in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:110: DB::TemporaryTableHolder::TemporaryTableHolder(std::shared_ptr<DB::Context const>, std::function<std::shared_ptr<DB::IStorage> (DB::StorageID const&)> const&, std::shared_ptr<DB::IAST> const&) @ 0x0000000037ac4164 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f1838 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:06.922469 [ 3151 ] {a3bc26bc-7012-4bb7-be77-25123000f457} <Error> TCPHandler: Code: 36. DB::Exception: Engine Memory doesn't support PARTITION_BY, PRIMARY_KEY, ORDER_BY or SAMPLE_BY clauses. Currently only the following engines have support for the feature: [AzureBlobStorage, KeeperMap, S3Queue, HDFS, MaterializedPostgreSQL, S3, ReplicatedVersionedCollapsingMergeTree, OSS, ReplicatedSummingMergeTree, COSN, Redis, MergeTree, ReplicatedReplacingMergeTree, VersionedCollapsingMergeTree, Hive, ReplacingMergeTree, ReplicatedAggregatingMergeTree, ReplicatedMergeTree, EmbeddedRocksDB, ReplicatedCollapsingMergeTree, ReplicatedGraphiteMergeTree, SummingMergeTree, GraphiteMergeTree, CollapsingMergeTree, AggregatingMergeTree]. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String&, String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, String&, String&, String&) @ 0x0000000020afaf7e in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFactory.cpp:171: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const::$_0::operator()(String, std::function<bool (DB::StorageFactory::StorageFeatures)>) const @ 0x000000003bc0cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageFactory.cpp:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0a847 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageID const&)>::__call_impl<std::__function::__default_alloc_func<DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&)::$_0, std::shared_ptr<DB::IStorage> (DB::StorageID const&)>>(std::__function::__policy_storage const*, DB::StorageID const&) @ 0x00000000394099db in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:110: DB::TemporaryTableHolder::TemporaryTableHolder(std::shared_ptr<DB::Context const>, std::function<std::shared_ptr<DB::IStorage> (DB::StorageID const&)> const&, std::shared_ptr<DB::IAST> const&) @ 0x0000000037ac4164 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f1838 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:07.047781 [ 2339 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:07.500640 [ 6599 ] {fdc2d0c6-0453-46ac-b391-d3d555b88949} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43408) (comment: 01018_ambiguous_column.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:07.507147 [ 6599 ] {fdc2d0c6-0453-46ac-b391-d3d555b88949} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:08.058300 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:08.683317 [ 3151 ] {55ae932c-5211-4edb-ac6c-e8c2e94f2039} <Error> executeQuery: Code: 119. DB::Exception: Table engine is not specified in CREATE query. (ENGINE_REQUIRED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE TABLE mem AS SELECT 1 as n;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [46]>(int, char const (&) [46]) @ 0x000000000a75abd7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:916: DB::(anonymous namespace)::setDefaultTableEngine(DB::ASTStorage&, DB::DefaultTableEngine) @ 0x00000000393c6ca7 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x00000000393c0746 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:673: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b2cf8 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:08.685252 [ 3151 ] {55ae932c-5211-4edb-ac6c-e8c2e94f2039} <Error> TCPHandler: Code: 119. DB::Exception: Table engine is not specified in CREATE query. (ENGINE_REQUIRED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [46]>(int, char const (&) [46]) @ 0x000000000a75abd7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:916: DB::(anonymous namespace)::setDefaultTableEngine(DB::ASTStorage&, DB::DefaultTableEngine) @ 0x00000000393c6ca7 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x00000000393c0746 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:673: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b2cf8 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:10.009273 [ 3151 ] {2358e34e-06dc-403f-a8c2-e8c9e318b6b2} <Error> executeQuery: Code: 36. DB::Exception: Engine Memory doesn't support PARTITION_BY, PRIMARY_KEY, ORDER_BY or SAMPLE_BY clauses. Currently only the following engines have support for the feature: [AzureBlobStorage, KeeperMap, S3Queue, HDFS, MaterializedPostgreSQL, S3, ReplicatedVersionedCollapsingMergeTree, OSS, ReplicatedSummingMergeTree, COSN, Redis, MergeTree, ReplicatedReplacingMergeTree, VersionedCollapsingMergeTree, Hive, ReplacingMergeTree, ReplicatedAggregatingMergeTree, ReplicatedMergeTree, EmbeddedRocksDB, ReplicatedCollapsingMergeTree, ReplicatedGraphiteMergeTree, SummingMergeTree, GraphiteMergeTree, CollapsingMergeTree, AggregatingMergeTree]. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02184_default_table_engine.sql) (in query: /* ddl_entry=query-0000000041 */ CREATE TABLE test_bqd46a6w.mem UUID '97c34906-a335-45d0-8c88-b9cfb525fce3' (`n` UInt8) ENGINE = Memory ORDER BY n AS SELECT 1 AS n), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String&, String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, String&, String&, String&) @ 0x0000000020afaf7e in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFactory.cpp:171: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const::$_0::operator()(String, std::function<bool (DB::StorageFactory::StorageFeatures)>) const @ 0x000000003bc0cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageFactory.cpp:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0a847 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
12. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:10.009277 [ 2406 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:10.016970 [ 3151 ] {2358e34e-06dc-403f-a8c2-e8c9e318b6b2} <Error> executeQuery: Code: 36. DB::Exception: Engine Memory doesn't support PARTITION_BY, PRIMARY_KEY, ORDER_BY or SAMPLE_BY clauses. Currently only the following engines have support for the feature: [AzureBlobStorage, KeeperMap, S3Queue, HDFS, MaterializedPostgreSQL, S3, ReplicatedVersionedCollapsingMergeTree, OSS, ReplicatedSummingMergeTree, COSN, Redis, MergeTree, ReplicatedReplacingMergeTree, VersionedCollapsingMergeTree, Hive, ReplacingMergeTree, ReplicatedAggregatingMergeTree, ReplicatedMergeTree, EmbeddedRocksDB, ReplicatedCollapsingMergeTree, ReplicatedGraphiteMergeTree, SummingMergeTree, GraphiteMergeTree, CollapsingMergeTree, AggregatingMergeTree]. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40214) (comment: 02184_default_table_engine.sql) (in query: CREATE TABLE mem ORDER BY n AS SELECT 1 as n;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String&, String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, String&, String&, String&) @ 0x0000000020afaf7e in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFactory.cpp:171: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const::$_0::operator()(String, std::function<bool (DB::StorageFactory::StorageFeatures)>) const @ 0x000000003bc0cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageFactory.cpp:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0a847 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
12. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:10.118912 [ 3151 ] {2358e34e-06dc-403f-a8c2-e8c9e318b6b2} <Error> TCPHandler: Code: 36. DB::Exception: Engine Memory doesn't support PARTITION_BY, PRIMARY_KEY, ORDER_BY or SAMPLE_BY clauses. Currently only the following engines have support for the feature: [AzureBlobStorage, KeeperMap, S3Queue, HDFS, MaterializedPostgreSQL, S3, ReplicatedVersionedCollapsingMergeTree, OSS, ReplicatedSummingMergeTree, COSN, Redis, MergeTree, ReplicatedReplacingMergeTree, VersionedCollapsingMergeTree, Hive, ReplacingMergeTree, ReplicatedAggregatingMergeTree, ReplicatedMergeTree, EmbeddedRocksDB, ReplicatedCollapsingMergeTree, ReplicatedGraphiteMergeTree, SummingMergeTree, GraphiteMergeTree, CollapsingMergeTree, AggregatingMergeTree]. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String&, String&, String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, String&, String&, String&) @ 0x0000000020afaf7e in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFactory.cpp:171: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const::$_0::operator()(String, std::function<bool (DB::StorageFactory::StorageFeatures)>) const @ 0x000000003bc0cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageFactory.cpp:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0a847 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
12. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:11.049419 [ 2402 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:12.058829 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:12.327315 [ 2118 ] {6a67f1c4-6322-4106-beb3-1854cf3bc37b} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53142) (comment: 00173_group_by_use_nulls.sql) (in query: -- { echoOn }
 set allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:12.336550 [ 2118 ] {6a67f1c4-6322-4106-beb3-1854cf3bc37b} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:13.070913 [ 2340 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:13.617982 [ 3976 ] {7c2b8e26-f4b6-45ee-a8a3-22e21cea64b1} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 137.62 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43414) (comment: 00062_loyalty.sql) (in query: SELECT loyalty, count() AS c, bar(log(c + 1) * 1000, 0, log(6000) * 1000, 80) FROM (SELECT UserID, toInt8((yandex > google ? yandex / (yandex + google) : -google / (yandex + google)) * 10) AS loyalty FROM (SELECT UserID, sum(SearchEngineID = 2) AS yandex, sum(SearchEngineID = 3) AS google FROM test.hits WHERE SearchEngineID = 2 OR SearchEngineID = 3 GROUP BY UserID HAVING yandex + google > 10)) GROUP BY loyalty ORDER BY loyalty), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:14.086935 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:15.666299 [ 2412 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:16.537058 [ 3976 ] {7c2b8e26-f4b6-45ee-a8a3-22e21cea64b1} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 137.62 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:16.668316 [ 2406 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:17.670899 [ 2436 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:18.678589 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:19.680801 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:20.682995 [ 2377 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:21.684852 [ 2419 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:22.687286 [ 2443 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:23.688333 [ 2450 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:24.699760 [ 2442 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:25.715243 [ 2349 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:26.730765 [ 2340 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:27.746057 [ 2361 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:28.750790 [ 2317 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:29.771133 [ 2419 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:30.771863 [ 2398 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:31.784576 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:32.793542 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:33.796296 [ 2465 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:34.797516 [ 2454 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:35.800032 [ 2392 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:36.801713 [ 2372 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:38.125429 [ 3976 ] {1701e678-3c2b-4409-9a23-b2b6befd0bcd} <Error> executeQuery: Code: 36. DB::Exception: Cannot specify codec for column type ALIAS. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35986) (comment: 02725_alias_columns_should_not_allow_compression_codec.sql) (in query: CREATE TABLE IF NOT EXISTS alias_column_should_not_allow_compression_fail (`user_id` UUID, `user_id_hashed` ALIAS cityHash64(user_id) CODEC(LZ4HC(1))) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 26636, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 9154, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 2731579, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 83173, primary_key_compress_block_size = 77006), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [43]>(int, char const (&) [43]) @ 0x0000000009415677 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr<DB::Context const>, bool) @ 0x00000000393b125b in /usr/bin/clickhouse
4. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b4074 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:38.126502 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:38.128155 [ 3976 ] {1701e678-3c2b-4409-9a23-b2b6befd0bcd} <Error> TCPHandler: Code: 36. DB::Exception: Cannot specify codec for column type ALIAS. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [43]>(int, char const (&) [43]) @ 0x0000000009415677 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr<DB::Context const>, bool) @ 0x00000000393b125b in /usr/bin/clickhouse
4. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b4074 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:39.047691 [ 3976 ] {6c539ab0-7ae1-4afa-8ee7-9ddb869acb68} <Error> executeQuery: Code: 36. DB::Exception: Cannot specify codec for column type ALIAS. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35986) (comment: 02725_alias_columns_should_not_allow_compression_codec.sql) (in query: alter table alias_column_should_not_allow_compression modify column user_id_hashed codec(LZ4HC(1));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [43]>(int, char const (&) [43]) @ 0x0000000009415677 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92e9a0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:39.058061 [ 3976 ] {6c539ab0-7ae1-4afa-8ee7-9ddb869acb68} <Error> TCPHandler: Code: 36. DB::Exception: Cannot specify codec for column type ALIAS. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [43]>(int, char const (&) [43]) @ 0x0000000009415677 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92e9a0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:39.956990 [ 2398 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:39.957126 [ 3992 ] {a30851e9-9ced-4db8-8b45-07817266cbba} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 14.59 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47226) (comment: 00074_full_join.sql) (in query: SELECT CounterID, hits, visits FROM ( SELECT (CounterID % 100000) AS CounterID, count() AS hits FROM test.hits GROUP BY CounterID ) ANY INNER JOIN ( SELECT (CounterID % 100000) AS CounterID, sum(Sign) AS visits FROM test.visits GROUP BY CounterID HAVING visits > 0 ) USING CounterID WHERE hits = 0 OR visits = 0 ORDER BY hits + visits * 10 DESC, CounterID ASC LIMIT 20;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:39.957400 [ 3976 ] {5fea9cba-187d-42ff-98b6-d1676a25184a} <Error> executeQuery: Code: 36. DB::Exception: Cannot specify codec for column type ALIAS. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35986) (comment: 02725_alias_columns_should_not_allow_compression_codec.sql) (in query: alter table alias_column_should_not_allow_compression add column user_id_hashed_1 UInt64 ALIAS (cityHash64(user_id)) codec(LZ4HC(1));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [43]>(int, char const (&) [43]) @ 0x0000000009415677 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:110: DB::AlterCommand::parse(DB::ASTAlterCommand const*) @ 0x000000003b90a110 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f6fc1 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:40.060063 [ 3976 ] {5fea9cba-187d-42ff-98b6-d1676a25184a} <Error> TCPHandler: Code: 36. DB::Exception: Cannot specify codec for column type ALIAS. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [43]>(int, char const (&) [43]) @ 0x0000000009415677 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:110: DB::AlterCommand::parse(DB::ASTAlterCommand const*) @ 0x000000003b90a110 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f6fc1 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:41.044654 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:42.586096 [ 3992 ] {a30851e9-9ced-4db8-8b45-07817266cbba} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 14.59 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:42.586230 [ 3101 ] {3df9300a-d8fb-44af-b943-2c641f36be68} <Error> executeQuery: Code: 41. DB::Exception: Value 1 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('AD 1999', 'G Y'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('AD 1999', 'G Y');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:33:42.586700 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:42.588722 [ 3101 ] {3df9300a-d8fb-44af-b943-2c641f36be68} <Error> TCPHandler: Code: 41. DB::Exception: Value 1 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('AD 1999', 'G Y'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:33:43.614956 [ 2339 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:43.616299 [ 3101 ] {139516e9-4770-4be0-8e47-880394c50eb6} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input AD 1999 is malformed at 99: While processing parseDateTimeInJodaSyntax('AD 1999', 'G YY'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('AD 1999', 'G YY');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:33:43.619845 [ 3101 ] {139516e9-4770-4be0-8e47-880394c50eb6} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input AD 1999 is malformed at 99: While processing parseDateTimeInJodaSyntax('AD 1999', 'G YY'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:33:43.649368 [ 3101 ] {2e1011f1-eec9-447e-8d8d-ef24a27ef69a} <Error> executeQuery: Code: 41. DB::Exception: Value 199 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('AD 1999', 'G YYY'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('AD 1999', 'G YYY');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:33:43.654519 [ 3101 ] {2e1011f1-eec9-447e-8d8d-ef24a27ef69a} <Error> TCPHandler: Code: 41. DB::Exception: Value 199 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('AD 1999', 'G YYY'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:33:45.823755 [ 2354 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:45.830227 [ 3101 ] {f3f25480-ab7a-4d32-84e8-09055c3b74b1} <Error> executeQuery: Code: 41. DB::Exception: Era BC exceeds the range of DateTime: While processing parseDateTimeInJodaSyntax('BC', 'G'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('BC', 'G');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [37]>(int, char const (&) [37]) @ 0x000000000ca077f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setEra(String const&) @ 0x000000001ad00f7c in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaEra(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf6373 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad00c02 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:33:45.836516 [ 3101 ] {f3f25480-ab7a-4d32-84e8-09055c3b74b1} <Error> TCPHandler: Code: 41. DB::Exception: Era BC exceeds the range of DateTime: While processing parseDateTimeInJodaSyntax('BC', 'G'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [37]>(int, char const (&) [37]) @ 0x000000000ca077f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setEra(String const&) @ 0x000000001ad00f7c in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaEra(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf6373 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad00c02 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:33:47.342917 [ 3101 ] {6fba6b73-ed17-4dad-bdf3-7ef0b4cc7bd4} <Error> executeQuery: Code: 41. DB::Exception: Unknown era ab (expected 'ad' or 'bc'): While processing parseDateTimeInJodaSyntax('AB', 'G'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('AB', 'G');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setEra(String const&) @ 0x000000001ad00eec in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaEra(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf6373 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad00c02 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:33:47.343098 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:47.344819 [ 3101 ] {6fba6b73-ed17-4dad-bdf3-7ef0b4cc7bd4} <Error> TCPHandler: Code: 41. DB::Exception: Unknown era ab (expected 'ad' or 'bc'): While processing parseDateTimeInJodaSyntax('AB', 'G'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setEra(String const&) @ 0x000000001ad00eec in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaEra(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf6373 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad00c02 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:33:47.785664 [ 3101 ] {f01eb53a-7cab-4896-9ae4-ab70670da691} <Error> executeQuery: Code: 41. DB::Exception: Value 1969 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('1969', 'YYYY', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('1969', 'YYYY', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:33:47.793658 [ 3101 ] {f01eb53a-7cab-4896-9ae4-ab70670da691} <Error> TCPHandler: Code: 41. DB::Exception: Value 1969 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('1969', 'YYYY', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:33:47.916530 [ 3101 ] {3a709f3f-a261-4768-be4b-e4741f94176f} <Error> executeQuery: Code: 41. DB::Exception: Value 2107 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('2107', 'YYYY', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('2107', 'YYYY', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:33:47.925786 [ 3101 ] {3a709f3f-a261-4768-be4b-e4741f94176f} <Error> TCPHandler: Code: 41. DB::Exception: Value 2107 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('2107', 'YYYY', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:33:49.430053 [ 3101 ] {6e236293-beef-45a5-8b1b-78aaed690cbf} <Error> executeQuery: Code: 41. DB::Exception: Unable to parse fragment YYYY from +1999 because read number failed: While processing parseDateTimeInJodaSyntax('+1999', 'YYYY', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('+1999', 'YYYY', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7d61 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:33:49.436142 [ 2450 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:54.535258 [ 2759 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:58.355785 [ 3101 ] {6e236293-beef-45a5-8b1b-78aaed690cbf} <Error> TCPHandler: Code: 41. DB::Exception: Unable to parse fragment YYYY from +1999 because read number failed: While processing parseDateTimeInJodaSyntax('+1999', 'YYYY', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7d61 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:33:58.355929 [ 3976 ] {test_15_hash_table_sizes_stats_962712092} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42860) (comment: 02151_hash_table_sizes_stats.sh) (in query: -- size_hint = 1000005 despite the presence of limit --
 SELECT number FROM t_hash_table_sizes_stats_158955863 GROUP BY number WITH ROLLUP LIMIT 5 SETTINGS max_threads = 5, group_by_two_level_threshold = 1000006, group_by_two_level_threshold_bytes = 1000005000 FORMAT Null;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:33:58.958071 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 4205757 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:33:58.959966 [ 3982 ] {da35bb89-aea0-4448-960e-716b4dd3027a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1052672 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 72 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42880) (comment: 00009_uniq_distributed.sql) (in query: SELECT uniq(UserID), uniqIf(UserID, CounterID = 800784), uniqIf(FUniqID, RegionID = 213) FROM remote('127.0.0.{1,2}', test, hits) ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e673 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:34:00.488421 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 4331934 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::savingThreadFunction() @ 0x000000003a42c002 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c45ea7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:00.503028 [ 2331 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:02.454892 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 4366702 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:04.258673 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4203006 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.159706 [ 2860 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.159846 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4195613 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.159989 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_1_50_8}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1065076 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_49_49_0/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 166): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.160130 [ 3976 ] {test_15_hash_table_sizes_stats_962712092} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:06.160253 [ 3982 ] {da35bb89-aea0-4448-960e-716b4dd3027a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1052672 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 72 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e673 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:34:06.160328 [ 3207 ] {cc34ea6a-6fba-44d6-a2e8-8b3bb0ed0747} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 33751103 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36028) (comment: 01655_plan_optimizations_optimize_read_in_window_order_long.sh) (in query: optimize table test_01655_plan_optimizations_optimize_read_in_window_order_long_n final), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.h:104: DB::StorageMergeTree::merge(bool, String const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::MergeTreeTransaction> const&, String&, bool) @ 0x000000003da40f6f in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/StorageMergeTree.cpp:1520: DB::StorageMergeTree::optimize(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::IAST> const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da55447 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:436: DB::InterpreterOptimizeQuery::execute() @ 0x0000000039aedf74 in /usr/bin/clickhouse

2024.09.24 02:34:06.170826 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_40_79_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1110623 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.170928 [ 3186 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.174670 [ 2459 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.190971 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1310720 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_3_3_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 19 with max_rows_to_read = 7411): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad0b7 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/ReadBuffer.h:71: void DB::deserializeBinarySSE2<3>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037014f9f in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:249: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124fd in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:612: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForOneColumn() const @ 0x000000003cddd35f in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:842: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::VerticalMergeStage::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8ed8 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000003cde562e in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.191131 [ 3239 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:40012). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:06.197671 [ 3207 ] {cc34ea6a-6fba-44d6-a2e8-8b3bb0ed0747} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 33751103 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.h:104: DB::StorageMergeTree::merge(bool, String const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::MergeTreeTransaction> const&, String&, bool) @ 0x000000003da40f6f in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/StorageMergeTree.cpp:1520: DB::StorageMergeTree::optimize(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::IAST> const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da55447 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:436: DB::InterpreterOptimizeQuery::execute() @ 0x0000000039aedf74 in /usr/bin/clickhouse

2024.09.24 02:34:06.959495 [ 3101 ] {8b05e88c-08b6-4e35-b791-39e53c04b06d} <Error> executeQuery: Code: 41. DB::Exception: Value 1 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('1', 'YY', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('1', 'YY', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:06.967094 [ 3101 ] {8b05e88c-08b6-4e35-b791-39e53c04b06d} <Error> TCPHandler: Code: 41. DB::Exception: Value 1 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('1', 'YY', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYearOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf7fd7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:07.180798 [ 2424 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:08.266131 [ 2751 ] {da993e85-2085-4c5a-899f-927e82f46159} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 74.28 MiB (attempt to allocate chunk of 2080768 bytes), maximum: 9.31 GiB: (while reading column GoalsReached): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 369 with max_rows_to_read = 73400): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42924) (comment: 00051_min_max_array.sql) (in query: SELECT CounterID, count(), max(GoalsReached), min(GoalsReached), minIf(GoalsReached, notEmpty(GoalsReached)) FROM test.hits GROUP BY CounterID ORDER BY count() DESC LIMIT 20 SETTINGS optimize_aggregation_in_order = 1 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/PODArray.h:222: DB::(anonymous namespace)::arrayOffsetsToSizes(DB::IColumn const&) @ 0x0000000036ed8fa6 in /usr/bin/clickhouse
9. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036edd8f2 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:09.779327 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:09.780172 [ 3101 ] {610a268e-2441-4d22-a01f-0fa9dc2ebf40} <Error> executeQuery: Code: 41. DB::Exception: Value 1969 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('1969', 'yyyy', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('1969', 'yyyy', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfb906 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:11.197757 [ 2751 ] {da993e85-2085-4c5a-899f-927e82f46159} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 74.28 MiB (attempt to allocate chunk of 2080768 bytes), maximum: 9.31 GiB: (while reading column GoalsReached): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 369 with max_rows_to_read = 73400): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/PODArray.h:222: DB::(anonymous namespace)::arrayOffsetsToSizes(DB::IColumn const&) @ 0x0000000036ed8fa6 in /usr/bin/clickhouse
9. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036edd8f2 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:11.197819 [ 3101 ] {610a268e-2441-4d22-a01f-0fa9dc2ebf40} <Error> TCPHandler: Code: 41. DB::Exception: Value 1969 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('1969', 'yyyy', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfb906 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:11.197894 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4218384 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:11.197961 [ 2782 ] {64ed7025-cf1e-4125-b38b-7d52cba0e6d5} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34086) (comment: 00169_contingency.sql) (in query: WITH ClientIP AS a, RemoteIP AS b SELECT round(cramersV(a, b), 2), round(cramersVBiasCorrected(a, b), 2), round(theilsU(a, b), 2), round(theilsU(b, a), 2), round(contingency(a, b), 2) FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:14.088634 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4216794 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:269: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66b425 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:14.088702 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:14.090426 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_53_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:14.090443 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:14.091707 [ 2782 ] {64ed7025-cf1e-4125-b38b-7d52cba0e6d5} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:14.096740 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_40_79_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 2801664 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (avg_value_size_hint = 134.311767578125, avg_chars_size = 151.57412109375, limit = 8192): (while reading column message): (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_40_73_5/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:14.270099 [ 3101 ] {4d663855-edbb-4ec5-98c9-7f92412094e3} <Error> executeQuery: Code: 41. DB::Exception: Value 2107 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('2107', 'yyyy', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('2107', 'yyyy', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfb906 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:14.277255 [ 3101 ] {4d663855-edbb-4ec5-98c9-7f92412094e3} <Error> TCPHandler: Code: 41. DB::Exception: Value 2107 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('2107', 'yyyy', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfb906 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:15.097041 [ 2386 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:17.101002 [ 3101 ] {75f63881-17f4-4753-9e47-8988f34d3e4b} <Error> executeQuery: Code: 321. DB::Exception: Seconds since epoch is negative: While processing parseDateTimeInJodaSyntax('1970', 'xxxx', 'UTC'). (VALUE_IS_OUT_OF_RANGE_OF_DATA_TYPE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('1970', 'xxxx', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [32]>(int, char const (&) [32]) @ 0x000000001ad46157 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac89109 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:34:17.106833 [ 2390 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:17.114295 [ 3101 ] {75f63881-17f4-4753-9e47-8988f34d3e4b} <Error> TCPHandler: Code: 321. DB::Exception: Seconds since epoch is negative: While processing parseDateTimeInJodaSyntax('1970', 'xxxx', 'UTC'). (VALUE_IS_OUT_OF_RANGE_OF_DATA_TYPE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [32]>(int, char const (&) [32]) @ 0x000000001ad46157 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac89109 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:34:18.507145 [ 2404 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:18.522291 [ 3101 ] {8cbb7f6b-607b-4598-90fa-912aee437ed3} <Error> executeQuery: Code: 41. DB::Exception: Value 1969 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('1969', 'xxxx', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('1969', 'xxxx', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaWeekYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf8380 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:18.531943 [ 3101 ] {8cbb7f6b-607b-4598-90fa-912aee437ed3} <Error> TCPHandler: Code: 41. DB::Exception: Value 1969 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('1969', 'xxxx', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaWeekYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf8380 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:18.628351 [ 3101 ] {d367cf5c-3f3e-476c-993b-d547b8b53019} <Error> executeQuery: Code: 41. DB::Exception: Value 2107 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('2107', 'xxxx', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('2107', 'xxxx', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaWeekYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf8380 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:18.635469 [ 3101 ] {d367cf5c-3f3e-476c-993b-d547b8b53019} <Error> TCPHandler: Code: 41. DB::Exception: Value 2107 for year must be in the range [1970, 2106]: While processing parseDateTimeInJodaSyntax('2107', 'xxxx', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int const&, int const&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int const&>::type, std::type_identity<int const&>::type>, int&, int const&, int const&) @ 0x000000001ad43671 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaWeekYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf8380 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:20.571308 [ 2355 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:20.571495 [ 3101 ] {cc8ec774-faa9-4cc7-9a7e-d6841bd129ad} <Error> executeQuery: Code: 41. DB::Exception: Invalid date, out of range (year: 1900 month: 1 day_of_month: 1): While processing parseDateTimeInJodaSyntax('19', 'CC', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('19', 'CC', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&, int&) @ 0x000000001ad46a31 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::daysSinceEpochFromDate(int, int, int) @ 0x000000001ac9ddd9 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac88a72 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:20.579488 [ 3101 ] {cc8ec774-faa9-4cc7-9a7e-d6841bd129ad} <Error> TCPHandler: Code: 41. DB::Exception: Invalid date, out of range (year: 1900 month: 1 day_of_month: 1): While processing parseDateTimeInJodaSyntax('19', 'CC', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&, int&) @ 0x000000001ad46a31 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::daysSinceEpochFromDate(int, int, int) @ 0x000000001ac9ddd9 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac88a72 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:22.301511 [ 3101 ] {eb2dfec9-f478-443e-a85c-9eef33e0e2ed} <Error> executeQuery: Code: 41. DB::Exception: Value 22 for century must be in the range [19, 21]: While processing parseDateTimeInJodaSyntax('22', 'CC', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('22', 'CC', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaCenturyOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf72e7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:23.819424 [ 3101 ] {eb2dfec9-f478-443e-a85c-9eef33e0e2ed} <Error> TCPHandler: Code: 41. DB::Exception: Value 22 for century must be in the range [19, 21]: While processing parseDateTimeInJodaSyntax('22', 'CC', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaCenturyOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf72e7 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:23.821986 [ 2467 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:23.823723 [ 2950 ] {bf4d4990-2d2d-49e6-940f-c2516a62982d} <Error> executeQuery: Code: 70. DB::Exception: Conversion from AggregateFunction(argMax, String, UInt64) to AggregateFunction(argMax, Enum8('<Empty>' = -1, 'Male' = 1, 'Female' = 2), UInt64) is not supported: While processing _CAST(arrayReduce('argMaxState', ['cast(-1, \'Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2)'], [toUInt64(0)]) AS t_tmp_alter9504808251324123174, 'AggregateFunction(argMax, Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2), UInt64)') AS t: default expression and column type are incompatible. (CANNOT_CONVERT_TYPE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44666) (comment: 01258_wrong_cast_filimonov.sql) (in query: CREATE TABLE x (`id` UInt64, `t` AggregateFunction(argMax, Enum8('<Empty>' = -1, 'Male' = 1, 'Female' = 2), UInt64) DEFAULT arrayReduce('argMaxState', ['cast(-1, \'Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2)'], [toUInt64(0)])) ENGINE = MergeTree ORDER BY id SETTINGS index_granularity = 23902, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 1266, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 4557115414, index_granularity_bytes = 21944569, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 55106, primary_key_compress_block_size = 8685), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionCast<DB::CastInternalName>::createAggregateFunctionWrapper(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeAggregateFunction const*) const @ 0x000000000942d569 in /usr/bin/clickhouse
4. DB::FunctionCast<DB::CastInternalName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x000000000941cfce in /usr/bin/clickhouse
5. DB::FunctionCast<DB::CastInternalName>::prepareRemoveNullable(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x0000000009415b42 in /usr/bin/clickhouse
6. DB::FunctionCast<DB::CastInternalName>::prepareUnpackDictionaries(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&) const @ 0x000000000940ef00 in /usr/bin/clickhouse
7. DB::FunctionCast<DB::CastInternalName>::prepare(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000940d4df in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d8ece in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ExpressionAnalyzer::getActionsDAG(bool, bool) @ 0x0000000037cdeff8 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1729: DB::ExpressionAnalyzer::getActions(bool, bool, DB::CompileExpressions) @ 0x0000000037cdff13 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/ColumnsDescription.cpp:847: DB::validateColumnsDefaultsAndGetSampleBlock(std::shared_ptr<DB::IAST>, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>) @ 0x000000003b970f51 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr<DB::Context const>, bool) @ 0x00000000393ad872 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b4074 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse

2024.09.24 02:34:23.828715 [ 2950 ] {bf4d4990-2d2d-49e6-940f-c2516a62982d} <Error> TCPHandler: Code: 70. DB::Exception: Conversion from AggregateFunction(argMax, String, UInt64) to AggregateFunction(argMax, Enum8('<Empty>' = -1, 'Male' = 1, 'Female' = 2), UInt64) is not supported: While processing _CAST(arrayReduce('argMaxState', ['cast(-1, \'Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2)'], [toUInt64(0)]) AS t_tmp_alter9504808251324123174, 'AggregateFunction(argMax, Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2), UInt64)') AS t: default expression and column type are incompatible. (CANNOT_CONVERT_TYPE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionCast<DB::CastInternalName>::createAggregateFunctionWrapper(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeAggregateFunction const*) const @ 0x000000000942d569 in /usr/bin/clickhouse
4. DB::FunctionCast<DB::CastInternalName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x000000000941cfce in /usr/bin/clickhouse
5. DB::FunctionCast<DB::CastInternalName>::prepareRemoveNullable(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x0000000009415b42 in /usr/bin/clickhouse
6. DB::FunctionCast<DB::CastInternalName>::prepareUnpackDictionaries(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&) const @ 0x000000000940ef00 in /usr/bin/clickhouse
7. DB::FunctionCast<DB::CastInternalName>::prepare(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000940d4df in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d8ece in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ExpressionAnalyzer::getActionsDAG(bool, bool) @ 0x0000000037cdeff8 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1729: DB::ExpressionAnalyzer::getActions(bool, bool, DB::CompileExpressions) @ 0x0000000037cdff13 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/ColumnsDescription.cpp:847: DB::validateColumnsDefaultsAndGetSampleBlock(std::shared_ptr<DB::IAST>, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>) @ 0x000000003b970f51 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr<DB::Context const>, bool) @ 0x00000000393ad872 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b4074 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse

2024.09.24 02:34:25.997073 [ 3101 ] {93e030af-74fa-4e89-91bb-2189fceb4cbc} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for month of year must be in the range [1, 12]: While processing parseDateTimeInJodaSyntax('0', 'M', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('0', 'M', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMonthOfYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfc087 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:25.998842 [ 2361 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:26.010083 [ 3101 ] {93e030af-74fa-4e89-91bb-2189fceb4cbc} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for month of year must be in the range [1, 12]: While processing parseDateTimeInJodaSyntax('0', 'M', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMonthOfYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfc087 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:26.153858 [ 3101 ] {6e7a802d-8345-4e16-8b07-dc4c17813085} <Error> executeQuery: Code: 41. DB::Exception: Value 13 for month of year must be in the range [1, 12]: While processing parseDateTimeInJodaSyntax('13', 'M', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('13', 'M', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMonthOfYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfc087 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:26.158335 [ 3101 ] {6e7a802d-8345-4e16-8b07-dc4c17813085} <Error> TCPHandler: Code: 41. DB::Exception: Value 13 for month of year must be in the range [1, 12]: While processing parseDateTimeInJodaSyntax('13', 'M', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMonthOfYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfc087 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:26.209278 [ 3101 ] {a88bf788-6c5a-42f6-b053-5f181bef8d91} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input 12345 is malformed at 345: While processing parseDateTimeInJodaSyntax('12345', 'M', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('12345', 'M', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.214938 [ 3101 ] {a88bf788-6c5a-42f6-b053-5f181bef8d91} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input 12345 is malformed at 345: While processing parseDateTimeInJodaSyntax('12345', 'M', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.623110 [ 3101 ] {1dc980db-5a23-4fd1-8b42-9f20ba40e285} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input Decembr is malformed at embr: While processing parseDateTimeInJodaSyntax('Decembr', 'MMM', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: --- invalid month names
 select parseDateTimeInJodaSyntax('Decembr', 'MMM', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.634034 [ 3101 ] {1dc980db-5a23-4fd1-8b42-9f20ba40e285} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input Decembr is malformed at embr: While processing parseDateTimeInJodaSyntax('Decembr', 'MMM', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.694336 [ 3101 ] {a8b97950-a4fa-4165-8833-fa7adc977434} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input Decembr is malformed at embr: While processing parseDateTimeInJodaSyntax('Decembr', 'MMMM', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('Decembr', 'MMMM', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.706655 [ 3101 ] {a8b97950-a4fa-4165-8833-fa7adc977434} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input Decembr is malformed at embr: While processing parseDateTimeInJodaSyntax('Decembr', 'MMMM', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.801154 [ 3101 ] {49c68ed7-4145-428d-a9c8-d720f609dffd} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input Decemberary is malformed at ary: While processing parseDateTimeInJodaSyntax('Decemberary', 'MMM', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('Decemberary', 'MMM', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.807712 [ 3101 ] {49c68ed7-4145-428d-a9c8-d720f609dffd} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input Decemberary is malformed at ary: While processing parseDateTimeInJodaSyntax('Decemberary', 'MMM', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.865589 [ 3101 ] {18e49295-4bbc-48bb-ba67-42eb18831c40} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input Decemberary is malformed at ary: While processing parseDateTimeInJodaSyntax('Decemberary', 'MMMM', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('Decemberary', 'MMMM', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:26.930426 [ 3101 ] {18e49295-4bbc-48bb-ba67-42eb18831c40} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input Decemberary is malformed at ary: While processing parseDateTimeInJodaSyntax('Decemberary', 'MMMM', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:28.076398 [ 3101 ] {3fab521d-f179-46a1-b275-0db82aa85280} <Error> executeQuery: Code: 41. DB::Exception: Unable to parse fragment MMM from asdf because of unknown month of year text: asd: While processing parseDateTimeInJodaSyntax('asdf', 'MMM', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('asdf', 'MMM', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>, String&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<String&>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&, String&) @ 0x000000001ad40d18 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMonthOfYearText(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfd4f3 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad00c02 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:28.078110 [ 2458 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:28.087114 [ 3101 ] {3fab521d-f179-46a1-b275-0db82aa85280} <Error> TCPHandler: Code: 41. DB::Exception: Unable to parse fragment MMM from asdf because of unknown month of year text: asd: While processing parseDateTimeInJodaSyntax('asdf', 'MMM', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>, String&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<String&>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&, String&) @ 0x000000001ad40d18 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMonthOfYearText(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfd4f3 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad00c02 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:28.234057 [ 3101 ] {cdb00178-d361-4fda-a535-c7ab972efa1f} <Error> executeQuery: Code: 41. DB::Exception: Unable to parse fragment MMMM from asdf because of unknown month of year text: asd: While processing parseDateTimeInJodaSyntax('asdf', 'MMMM', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('asdf', 'MMMM', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>, String&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<String&>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&, String&) @ 0x000000001ad40d18 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMonthOfYearText(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfd4f3 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad00c02 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:28.235924 [ 3101 ] {cdb00178-d361-4fda-a535-c7ab972efa1f} <Error> TCPHandler: Code: 41. DB::Exception: Unable to parse fragment MMMM from asdf because of unknown month of year text: asd: While processing parseDateTimeInJodaSyntax('asdf', 'MMMM', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>, String&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<String&>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&, String&) @ 0x000000001ad40d18 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMonthOfYearText(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfd4f3 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(int, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad00c02 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.484600 [ 3101 ] {c5dae40b-1930-448e-a418-7b41d7a71cf1} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for day of month must be in the range [1, 31]: While processing parseDateTimeInJodaSyntax('0', 'd', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('0', 'd', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaDayOfMonth(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfdbcb in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.489705 [ 3101 ] {c5dae40b-1930-448e-a418-7b41d7a71cf1} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for day of month must be in the range [1, 31]: While processing parseDateTimeInJodaSyntax('0', 'd', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaDayOfMonth(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfdbcb in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.512448 [ 3101 ] {287a3256-0dc6-43d4-9fc6-598f01ca3ad7} <Error> executeQuery: Code: 41. DB::Exception: Value 32 for day of month must be in the range [1, 31]: While processing parseDateTimeInJodaSyntax('32', 'd', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('32', 'd', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaDayOfMonth(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfdbcb in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.513778 [ 3101 ] {287a3256-0dc6-43d4-9fc6-598f01ca3ad7} <Error> TCPHandler: Code: 41. DB::Exception: Value 32 for day of month must be in the range [1, 31]: While processing parseDateTimeInJodaSyntax('32', 'd', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaDayOfMonth(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfdbcb in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.637817 [ 3101 ] {fea07d85-760d-468e-9fd5-469b5a9fb067} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input 12345 is malformed at 345: While processing parseDateTimeInJodaSyntax('12345', 'd', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('12345', 'd', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:30.642518 [ 3101 ] {fea07d85-760d-468e-9fd5-469b5a9fb067} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input 12345 is malformed at 345: While processing parseDateTimeInJodaSyntax('12345', 'd', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:30.665817 [ 3101 ] {03f3a657-6fee-48af-9dbf-0c2b6a55927c} <Error> executeQuery: Code: 41. DB::Exception: Invalid date, out of range (year: 2000 month: 2 day_of_month: 31): While processing parseDateTimeInJodaSyntax('02-31', 'M-d', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('02-31', 'M-d', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&, int&) @ 0x000000001ad46a31 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::daysSinceEpochFromDate(int, int, int) @ 0x000000001ac9ddd9 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac88a72 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.667564 [ 3101 ] {03f3a657-6fee-48af-9dbf-0c2b6a55927c} <Error> TCPHandler: Code: 41. DB::Exception: Invalid date, out of range (year: 2000 month: 2 day_of_month: 31): While processing parseDateTimeInJodaSyntax('02-31', 'M-d', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&, int&) @ 0x000000001ad46a31 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::daysSinceEpochFromDate(int, int, int) @ 0x000000001ac9ddd9 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac88a72 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.687749 [ 3101 ] {99637325-7c51-4647-8f61-06b4861c63b6} <Error> executeQuery: Code: 41. DB::Exception: Invalid date, out of range (year: 2000 month: 4 day_of_month: 31): While processing parseDateTimeInJodaSyntax('04-31', 'M-d', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('04-31', 'M-d', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&, int&) @ 0x000000001ad46a31 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::daysSinceEpochFromDate(int, int, int) @ 0x000000001ac9ddd9 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac88a72 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.689245 [ 3101 ] {99637325-7c51-4647-8f61-06b4861c63b6} <Error> TCPHandler: Code: 41. DB::Exception: Invalid date, out of range (year: 2000 month: 4 day_of_month: 31): While processing parseDateTimeInJodaSyntax('04-31', 'M-d', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&, int&) @ 0x000000001ad46a31 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::daysSinceEpochFromDate(int, int, int) @ 0x000000001ac9ddd9 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac88a72 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:30.735507 [ 2326 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:31.372541 [ 3101 ] {67ff0c87-b3cc-47d1-8098-5e5f2b0c0d0d} <Error> executeQuery: Code: 41. DB::Exception: Invalid date, out of range (year: 2001 month: 2 day_of_month: 29): While processing parseDateTimeInJodaSyntax('2001-02-29', 'YYYY-M-d', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('2001-02-29', 'YYYY-M-d', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&, int&) @ 0x000000001ad46a31 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::daysSinceEpochFromDate(int, int, int) @ 0x000000001ac9ddd9 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac88a72 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:31.391105 [ 3101 ] {67ff0c87-b3cc-47d1-8098-5e5f2b0c0d0d} <Error> TCPHandler: Code: 41. DB::Exception: Invalid date, out of range (year: 2001 month: 2 day_of_month: 29): While processing parseDateTimeInJodaSyntax('2001-02-29', 'YYYY-M-d', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&, int&) @ 0x000000001ad46a31 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::daysSinceEpochFromDate(int, int, int) @ 0x000000001ac9ddd9 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac88a72 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:31.739914 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:33.408340 [ 6603 ] {87f7baeb-f769-4d31-a0bd-ac1009dcb6f1} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 19.98 MiB (attempt to allocate chunk of 1704064 bytes), maximum: 19.07 MiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44660) (comment: 01655_plan_optimizations_optimize_read_in_window_order_long.sh) (in query: select n, sum(x) OVER (ORDER BY n, x ROWS BETWEEN 100 PRECEDING AND CURRENT ROW) from test_01655_plan_optimizations_optimize_read_in_window_order_long_n SETTINGS optimize_read_in_order=0, optimize_read_in_window_order=0, max_memory_usage=20000000, max_threads=1 format Null), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b260a3f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<int>::less>(auto, auto, auto) const @ 0x000000003b64b629 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<int>::less, DB::ColumnVector<int>::equals, DB::ColumnVector<int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b340e77 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b34079e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:34.803473 [ 6603 ] {87f7baeb-f769-4d31-a0bd-ac1009dcb6f1} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 19.98 MiB (attempt to allocate chunk of 1704064 bytes), maximum: 19.07 MiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b260a3f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<int>::less>(auto, auto, auto) const @ 0x000000003b64b629 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<int>::less, DB::ColumnVector<int>::equals, DB::ColumnVector<int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b340e77 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b34079e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:34.803822 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:34.803837 [ 3101 ] {f9ac18b9-4f28-4df8-aba9-834450164a81} <Error> executeQuery: Code: 41. DB::Exception: Invalid day of year, out of range (year: 1999 day of year: 366): While processing parseDateTimeInJodaSyntax('1999 366', 'yyyy D', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('1999 366', 'yyyy D', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&) @ 0x000000001ad4656d in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac8939a in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:34:34.814139 [ 3101 ] {f9ac18b9-4f28-4df8-aba9-834450164a81} <Error> TCPHandler: Code: 41. DB::Exception: Invalid day of year, out of range (year: 1999 day of year: 366): While processing parseDateTimeInJodaSyntax('1999 366', 'yyyy D', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&) @ 0x000000001ad4656d in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac8939a in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:34:35.178608 [ 3101 ] {1d00374c-a728-42ef-a1e3-ca5b2a0bcc14} <Error> executeQuery: Code: 41. DB::Exception: Invalid day of year, out of range (year: 2001 day of year: 366): While processing parseDateTimeInJodaSyntax('2000 366 2001', 'yyyy D yyyy', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('2000 366 2001', 'yyyy D yyyy', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&) @ 0x000000001ad4656d in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac8939a in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:34:35.185188 [ 3101 ] {1d00374c-a728-42ef-a1e3-ca5b2a0bcc14} <Error> TCPHandler: Code: 41. DB::Exception: Invalid day of year, out of range (year: 2001 day of year: 366): While processing parseDateTimeInJodaSyntax('2000 366 2001', 'yyyy D yyyy', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type>, int&, int&) @ 0x000000001ad4656d in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::buildDateTime(DateLUTImpl const&) @ 0x000000001ac8939a in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acedf5b in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:34:36.765910 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:36.774292 [ 3101 ] {f0c31aff-a9b6-4ae7-9cf6-869a7fc5879f} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for day of year must be in the range [1, 366]: While processing parseDateTimeInJodaSyntax('0', 'D', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('0', 'D', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaDayOfYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfbcc4 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:36.782049 [ 3101 ] {f0c31aff-a9b6-4ae7-9cf6-869a7fc5879f} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for day of year must be in the range [1, 366]: While processing parseDateTimeInJodaSyntax('0', 'D', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaDayOfYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfbcc4 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:36.910513 [ 3101 ] {2d605392-b8e1-4252-857e-66ac2c423463} <Error> executeQuery: Code: 41. DB::Exception: Value 367 for day of year must be in the range [1, 366]: While processing parseDateTimeInJodaSyntax('367', 'D', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('367', 'D', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaDayOfYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfbcc4 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:36.915874 [ 3101 ] {2d605392-b8e1-4252-857e-66ac2c423463} <Error> TCPHandler: Code: 41. DB::Exception: Value 367 for day of year must be in the range [1, 366]: While processing parseDateTimeInJodaSyntax('367', 'D', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaDayOfYear(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfbcc4 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:38.991410 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:38.994658 [ 3101 ] {f933385d-01e9-422a-af76-28bc68993f03} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for hour must be in the range [23, 0] if_hour_of_half_day=false and hour_starts_at_1=false: While processing parseDateTimeInJodaSyntax('24', 'H', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: --- invalid hour od day
 select parseDateTimeInJodaSyntax('24', 'H', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe63c in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:40.088981 [ 3101 ] {f933385d-01e9-422a-af76-28bc68993f03} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for hour must be in the range [23, 0] if_hour_of_half_day=false and hour_starts_at_1=false: While processing parseDateTimeInJodaSyntax('24', 'H', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe63c in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:40.089149 [ 3992 ] {24824f44-c2d3-482f-9ec0-0d360c08bea5} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 20.05 MiB (attempt to allocate chunk of 1572864 bytes), maximum: 19.07 MiB.: (while reading column x): (while reading from part /var/lib/clickhouse/disks/s3/store/a77/a7749b1f-c547-4982-be7c-25e0f22897ac/all_2_2_0/ in table test_ai78rgkq.test_01655_plan_optimizations_optimize_read_in_window_order_long_n (a7749b1f-c547-4982-be7c-25e0f22897ac) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 40960): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47028) (comment: 01655_plan_optimizations_optimize_read_in_window_order_long.sh) (in query: select n, sum(x) OVER (ORDER BY n, x ROWS BETWEEN 100 PRECEDING AND CURRENT ROW) from test_01655_plan_optimizations_optimize_read_in_window_order_long_n SETTINGS optimize_read_in_order=1, max_memory_usage=20000000, max_threads=1 format Null), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cd9bf in /usr/bin/clickhouse
8. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
9. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:40.090961 [ 2466 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:42.063269 [ 3992 ] {24824f44-c2d3-482f-9ec0-0d360c08bea5} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 20.05 MiB (attempt to allocate chunk of 1572864 bytes), maximum: 19.07 MiB.: (while reading column x): (while reading from part /var/lib/clickhouse/disks/s3/store/a77/a7749b1f-c547-4982-be7c-25e0f22897ac/all_2_2_0/ in table test_ai78rgkq.test_01655_plan_optimizations_optimize_read_in_window_order_long_n (a7749b1f-c547-4982-be7c-25e0f22897ac) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 40960): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cd9bf in /usr/bin/clickhouse
8. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
9. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:42.069467 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:42.071803 [ 3101 ] {f1fa1c16-ad41-495d-859b-8c7e4507173e} <Error> executeQuery: Code: 41. DB::Exception: Unable to parse fragment H from -1 because read number failed: While processing parseDateTimeInJodaSyntax('-1', 'H', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('-1', 'H', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe620 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:42.082133 [ 3101 ] {f1fa1c16-ad41-495d-859b-8c7e4507173e} <Error> TCPHandler: Code: 41. DB::Exception: Unable to parse fragment H from -1 because read number failed: While processing parseDateTimeInJodaSyntax('-1', 'H', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe620 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:42.191009 [ 3101 ] {10fc7e27-2595-4913-81d8-873fc8c0ac2f} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 'H', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('123456789', 'H', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:42.206501 [ 3101 ] {10fc7e27-2595-4913-81d8-873fc8c0ac2f} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 'H', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:44.278482 [ 2415 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:44.281125 [ 3101 ] {a1eccf4e-7f1d-4905-9830-d630524b5380} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for hour must be in the range [24, 1] if_hour_of_half_day=false and hour_starts_at_1=true: While processing parseDateTimeInJodaSyntax('25', 'k', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: -- invalid clock hour of day
 select parseDateTimeInJodaSyntax('25', 'k', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaClockHourOfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe6ff in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:44.286946 [ 3101 ] {a1eccf4e-7f1d-4905-9830-d630524b5380} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for hour must be in the range [24, 1] if_hour_of_half_day=false and hour_starts_at_1=true: While processing parseDateTimeInJodaSyntax('25', 'k', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaClockHourOfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe6ff in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:44.312919 [ 3101 ] {ebb555d8-58c6-41a4-8451-1b3f33cdbc41} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for hour must be in the range [24, 1] if_hour_of_half_day=false and hour_starts_at_1=true: While processing parseDateTimeInJodaSyntax('0', 'k', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('0', 'k', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaClockHourOfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe6ff in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:44.318379 [ 3101 ] {ebb555d8-58c6-41a4-8451-1b3f33cdbc41} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for hour must be in the range [24, 1] if_hour_of_half_day=false and hour_starts_at_1=true: While processing parseDateTimeInJodaSyntax('0', 'k', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaClockHourOfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe6ff in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:44.373710 [ 3101 ] {207e2888-b7ae-4f17-bd14-2377319f2dc9} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 'k', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('123456789', 'k', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:44.385586 [ 3101 ] {207e2888-b7ae-4f17-bd14-2377319f2dc9} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 'k', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:46.672325 [ 2360 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:46.683176 [ 3101 ] {55ee475c-c381-49fd-ac01-9e5e6b46ad6b} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for hour must be in the range [11, 0] if_hour_of_half_day=true and hour_starts_at_1=false: While processing parseDateTimeInJodaSyntax('12', 'K', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: -- invalid hour of half day
 select parseDateTimeInJodaSyntax('12', 'K', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe47f in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:46.692262 [ 3101 ] {55ee475c-c381-49fd-ac01-9e5e6b46ad6b} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for hour must be in the range [11, 0] if_hour_of_half_day=true and hour_starts_at_1=false: While processing parseDateTimeInJodaSyntax('12', 'K', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe47f in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:47.957515 [ 2782 ] {157b4a9f-b208-4f27-b3a5-0995b5322edf} <Error> executeQuery: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/filesystem_caches/02810_system_sync_filesystem_cache_test_5/060/060b1f8a7c0026c6016212f66aefe4fb/0, errno: 2, strerror: No such file or directory: Cache info: Buffer path: common/eix/rqduqcsatzcipqazmjdugpuuczmid, hash key: 060b1f8a7c0026c6016212f66aefe4fb, file_offset_of_buffer_end: 0, read_until_position: 61, internal buffer end: None, read_type: CACHED, last caller: 157b4a9f-b208-4f27-b3a5-0995b5322edf:16222, file segment info: File segment: [0, 60], key: 060b1f8a7c0026c6016212f66aefe4fb, state: DOWNLOADED, downloaded size: 61, reserved size: 61, downloader id: None, current write offset: 61, caller id: 157b4a9f-b208-4f27-b3a5-0995b5322edf:16222, kind: Regular, unbound: 0: (while reading from part /var/lib/clickhouse/disks/s3_disk/store/cf5/cf5be013-1638-43d5-8447-18174fe0fc07/all_1_1_0/ in table test_5.test (cf5be013-1638-43d5-8447-18174fe0fc07) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeInOrder. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60860) (comment: 02810_system_sync_filesystem_cache.sh) (in query: SELECT * FROM test FORMAT Null SETTINGS enable_filesystem_cache_log = 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::OpenedFile::open() const @ 0x0000000035365ec6 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/OpenedFile.cpp:0: DB::OpenedFile::getFD() const @ 0x0000000035365ffe in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadBufferFromFile.h:0: DB::ReadBufferFromFilePReadWithDescriptorsCache::ReadBufferFromFilePReadWithDescriptorsCache(String const&, unsigned long, int, char*, unsigned long, std::optional<unsigned long>, std::shared_ptr<DB::Throttler>) @ 0x000000003533ad62 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::createReadBufferFromFileBase(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>, int, char*, unsigned long)::$_0::operator()(unsigned long, unsigned long, int) const @ 0x000000003533900b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/createReadBufferFromFileBase.cpp:216: DB::createReadBufferFromFileBase(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>, int, char*, unsigned long) @ 0x0000000035338c10 in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::getCacheReadBuffer(DB::FileSegment const&) @ 0x00000000357a6c81 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:311: DB::CachedOnDiskReadBufferFromFile::getReadBufferForFileSegment(DB::FileSegment&) @ 0x00000000357ab3bc in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::getImplementationBuffer(DB::FileSegment&) @ 0x00000000357accb0 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bb86b in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x00000000357922d0 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a96c6 in /usr/bin/clickhouse
18. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
19. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036fadc93 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse

2024.09.24 02:34:49.477051 [ 2782 ] {157b4a9f-b208-4f27-b3a5-0995b5322edf} <Error> TCPHandler: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/filesystem_caches/02810_system_sync_filesystem_cache_test_5/060/060b1f8a7c0026c6016212f66aefe4fb/0, errno: 2, strerror: No such file or directory: Cache info: Buffer path: common/eix/rqduqcsatzcipqazmjdugpuuczmid, hash key: 060b1f8a7c0026c6016212f66aefe4fb, file_offset_of_buffer_end: 0, read_until_position: 61, internal buffer end: None, read_type: CACHED, last caller: 157b4a9f-b208-4f27-b3a5-0995b5322edf:16222, file segment info: File segment: [0, 60], key: 060b1f8a7c0026c6016212f66aefe4fb, state: DOWNLOADED, downloaded size: 61, reserved size: 61, downloader id: None, current write offset: 61, caller id: 157b4a9f-b208-4f27-b3a5-0995b5322edf:16222, kind: Regular, unbound: 0: (while reading from part /var/lib/clickhouse/disks/s3_disk/store/cf5/cf5be013-1638-43d5-8447-18174fe0fc07/all_1_1_0/ in table test_5.test (cf5be013-1638-43d5-8447-18174fe0fc07) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeInOrder. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::OpenedFile::open() const @ 0x0000000035365ec6 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/OpenedFile.cpp:0: DB::OpenedFile::getFD() const @ 0x0000000035365ffe in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadBufferFromFile.h:0: DB::ReadBufferFromFilePReadWithDescriptorsCache::ReadBufferFromFilePReadWithDescriptorsCache(String const&, unsigned long, int, char*, unsigned long, std::optional<unsigned long>, std::shared_ptr<DB::Throttler>) @ 0x000000003533ad62 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::createReadBufferFromFileBase(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>, int, char*, unsigned long)::$_0::operator()(unsigned long, unsigned long, int) const @ 0x000000003533900b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/createReadBufferFromFileBase.cpp:216: DB::createReadBufferFromFileBase(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>, int, char*, unsigned long) @ 0x0000000035338c10 in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::getCacheReadBuffer(DB::FileSegment const&) @ 0x00000000357a6c81 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:311: DB::CachedOnDiskReadBufferFromFile::getReadBufferForFileSegment(DB::FileSegment&) @ 0x00000000357ab3bc in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::getImplementationBuffer(DB::FileSegment&) @ 0x00000000357accb0 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bb86b in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x00000000357922d0 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a96c6 in /usr/bin/clickhouse
18. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
19. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036fadc93 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse

2024.09.24 02:34:49.483629 [ 2355 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:49.486395 [ 3101 ] {65bdb066-64d5-47ec-8238-597eaa05a1ca} <Error> executeQuery: Code: 41. DB::Exception: Unable to parse fragment K from -1 because read number failed: While processing parseDateTimeInJodaSyntax('-1', 'K', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('-1', 'K', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe460 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:49.503751 [ 3101 ] {65bdb066-64d5-47ec-8238-597eaa05a1ca} <Error> TCPHandler: Code: 41. DB::Exception: Unable to parse fragment K from -1 because read number failed: While processing parseDateTimeInJodaSyntax('-1', 'K', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe460 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:49.860157 [ 3101 ] {020aca01-5731-4440-ac21-9cacf435f048} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for hour must be in the range [11, 0] if_hour_of_half_day=true and hour_starts_at_1=false: While processing parseDateTimeInJodaSyntax('123456789', 'K', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('123456789', 'K', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe47f in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:49.863234 [ 3101 ] {020aca01-5731-4440-ac21-9cacf435f048} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for hour must be in the range [11, 0] if_hour_of_half_day=true and hour_starts_at_1=false: While processing parseDateTimeInJodaSyntax('123456789', 'K', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe47f in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:49.963367 [ 2782 ] {e64b9a4f-7b1c-4fc9-8103-71d6cbd81ea0} <Warning> CacheMetadata: File segment has DOWNLOADED state, but file does not exist (File segment: [0, 60], key: 060b1f8a7c0026c6016212f66aefe4fb, state: DOWNLOADED, downloaded size: 61, reserved size: 61, downloader id: None, current write offset: 61, caller id: e64b9a4f-7b1c-4fc9-8103-71d6cbd81ea0:2782, kind: Regular, unbound: 0)
2024.09.24 02:34:50.490063 [ 2467 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:52.115548 [ 2348 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:52.115817 [ 3101 ] {969b0c0a-e469-4430-9ebf-5f4ca2c41f3e} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for hour must be in the range [12, 1] if_hour_of_half_day=true and hour_starts_at_1=true: While processing parseDateTimeInJodaSyntax('13', 'h', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: -- invalid clock hour of half day
 select parseDateTimeInJodaSyntax('13', 'h', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaClockHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe562 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:52.803097 [ 3207 ] {d16d04d4-599b-4b70-a45c-a5d62e23b23e} <Warning> CacheMetadata: File segment has unexpected size. Having 3, expected 61 (File segment: [0, 60], key: 060b1f8a7c0026c6016212f66aefe4fb, state: DOWNLOADED, downloaded size: 61, reserved size: 61, downloader id: None, current write offset: 61, caller id: d16d04d4-599b-4b70-a45c-a5d62e23b23e:3207, kind: Regular, unbound: 0)
2024.09.24 02:34:53.297147 [ 3101 ] {969b0c0a-e469-4430-9ebf-5f4ca2c41f3e} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for hour must be in the range [12, 1] if_hour_of_half_day=true and hour_starts_at_1=true: While processing parseDateTimeInJodaSyntax('13', 'h', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaClockHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe562 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:53.297224 [ 3151 ] {909d56d4-0f8f-4f78-a220-a950f6322c27} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48274) (comment: 02154_dictionary_get_http_json.sh) (in query:  SELECT dictGet(02154_test_dictionary, 'value', toUInt64(0)), dictGet(02154_test_dictionary, 'value', toUInt64(1)) SETTINGS allow_experimental_analyzer = 1 FORMAT JSON), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:0: DB::InterpreterSetQuery::executeForCurrentContext(bool) @ 0x0000000039d96a79 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSetQuery.h:14: DB::applySettingsFromSelectWithUnion(DB::ASTSelectWithUnionQuery const&, std::shared_ptr<DB::Context>) @ 0x0000000039d99be8 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:64: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x0000000039d97c44 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a998da3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
13. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
14. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:53.297248 [ 2389 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:53.854430 [ 3982 ] {23bd21c9-24a6-41ed-aa00-5eb1c41985de} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 19.78 MiB (attempt to allocate chunk of 1572864 bytes), maximum: 19.07 MiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47076) (comment: 01655_plan_optimizations_optimize_read_in_window_order_long.sh) (in query: select n, sum(x) OVER (ORDER BY n, x ROWS BETWEEN 100 PRECEDING AND CURRENT ROW) from test_01655_plan_optimizations_optimize_read_in_window_order_long_n_x SETTINGS optimize_read_in_order=0, optimize_read_in_window_order=0, max_memory_usage=20000000, max_threads=1 format Null), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:53.855746 [ 3151 ] {909d56d4-0f8f-4f78-a220-a950f6322c27} <Error> DynamicQueryHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:0: DB::InterpreterSetQuery::executeForCurrentContext(bool) @ 0x0000000039d96a79 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSetQuery.h:14: DB::applySettingsFromSelectWithUnion(DB::ASTSelectWithUnionQuery const&, std::shared_ptr<DB::Context>) @ 0x0000000039d99be8 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:64: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x0000000039d97c44 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a998da3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
13. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
14. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:53.908991 [ 3982 ] {23bd21c9-24a6-41ed-aa00-5eb1c41985de} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 19.78 MiB (attempt to allocate chunk of 1572864 bytes), maximum: 19.07 MiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:34:53.912281 [ 3101 ] {b079c75a-abe1-4968-941b-af05e4409295} <Error> executeQuery: Code: 41. DB::Exception: Value 0 for hour must be in the range [12, 1] if_hour_of_half_day=true and hour_starts_at_1=true: While processing parseDateTimeInJodaSyntax('0', 'h', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('0', 'h', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaClockHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe562 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:53.919990 [ 3101 ] {b079c75a-abe1-4968-941b-af05e4409295} <Error> TCPHandler: Code: 41. DB::Exception: Value 0 for hour must be in the range [12, 1] if_hour_of_half_day=true and hour_starts_at_1=true: While processing parseDateTimeInJodaSyntax('0', 'h', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&, int&, int&, bool&, bool&>(int, FormatStringHelperImpl<std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<int&>::type, std::type_identity<bool&>::type, std::type_identity<bool&>::type>, int&, int&, int&, bool&, bool&) @ 0x000000001ad4525f in /usr/bin/clickhouse
3. DB::(anonymous namespace)::DateTime::setHour(int, bool, bool) @ 0x000000001ac9da13 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaClockHourOfHalfDay(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe562 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:34:54.081067 [ 3101 ] {7eb5dae5-bccc-42be-84f4-bd97de89ef2f} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 'h', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('123456789', 'h', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:54.087038 [ 3101 ] {7eb5dae5-bccc-42be-84f4-bd97de89ef2f} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 'h', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:34:54.302711 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:55.331007 [ 2345 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:56.371978 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:57.374946 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:59.201397 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:34:59.203922 [ 3101 ] {1e8a1f87-a602-4787-8c46-f8fa3dbe79e8} <Error> executeQuery: Code: 41. DB::Exception: Value 60 for minute must be in the range [0, 59]: While processing parseDateTimeInJodaSyntax('60', 'm', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('60', 'm', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMinuteOfHour(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe9e9 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:34:59.211198 [ 3101 ] {1e8a1f87-a602-4787-8c46-f8fa3dbe79e8} <Error> TCPHandler: Code: 41. DB::Exception: Value 60 for minute must be in the range [0, 59]: While processing parseDateTimeInJodaSyntax('60', 'm', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMinuteOfHour(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe9e9 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:35:01.241183 [ 3101 ] {0632a852-50bb-455a-8a40-a02cc7ecf5ae} <Error> executeQuery: Code: 41. DB::Exception: Unable to parse fragment m from -1 because read number failed: While processing parseDateTimeInJodaSyntax('-1', 'm', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('-1', 'm', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMinuteOfHour(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe7c8 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:35:01.247069 [ 2372 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:01.249271 [ 3101 ] {0632a852-50bb-455a-8a40-a02cc7ecf5ae} <Error> TCPHandler: Code: 41. DB::Exception: Unable to parse fragment m from -1 because read number failed: While processing parseDateTimeInJodaSyntax('-1', 'm', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaMinuteOfHour(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfe7c8 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:35:01.275474 [ 3101 ] {1eadc018-a343-4b41-8565-f6739845cc7a} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 'm', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('123456789', 'm', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:35:01.291038 [ 3101 ] {1eadc018-a343-4b41-8565-f6739845cc7a} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 'm', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:35:01.428885 [ 2782 ] {f86bed27-c4d9-48d7-914a-79ac974a7d51} <Error> executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52692) (in query: select _path,_file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:01.430226 [ 2782 ] {f86bed27-c4d9-48d7-914a-79ac974a7d51} <Error> TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:02.650747 [ 2782 ] {a284ecc0-f370-49bb-a1db-56d5cfbc5146} <Error> executeQuery: Code: 107. DB::Exception: Cannot open CapnProto schema, file /var/lib/clickhouse/format_schemas/nonexist.capnp doesn't exists: While executing File. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52714) (in query: select * from file('test_02149_external_schema_inference_test_13.data', 'CapnProto', 'val1 char') settings format_schema='nonexist:Message'), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Formats/CapnProtoSchema.cpp:47: DB::CapnProtoSchemaParser::getMessageSchema(DB::FormatSchemaInfo const&) @ 0x000000003e5463c6 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp:25: DB::CapnProtoRowInputFormat::CapnProtoRowInputFormat(DB::ReadBuffer&, DB::Block, DB::RowInputFormatParams, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema> const&, DB::FormatSettings const&) @ 0x000000003e53f5b1 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:0: DB::CapnProtoRowInputFormat* std::construct_at[abi:v15000]<DB::CapnProtoRowInputFormat, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema>, DB::FormatSettings const&, DB::CapnProtoRowInputFormat*>(DB::CapnProtoRowInputFormat*, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams&&, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema>&&, DB::FormatSettings const&) @ 0x000000003e544c43 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CapnProtoRowInputFormat> std::make_shared[abi:v15000]<DB::CapnProtoRowInputFormat, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema>, DB::FormatSettings const&, void>(DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams&&, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema>&&, DB::FormatSettings const&) @ 0x000000003e54479a in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp:0: std::shared_ptr<DB::IInputFormat> std::__function::__policy_invoker<std::shared_ptr<DB::IInputFormat> (DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerInputFormatCapnProto(DB::FormatFactory&)::$_0, std::shared_ptr<DB::IInputFormat> (DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&)>>(std::__function::__policy_storage const*, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&) @ 0x000000003e543226 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::FormatFactory::getInput(String const&, DB::ReadBuffer&, DB::Block const&, std::shared_ptr<DB::Context const>, unsigned long, std::optional<DB::FormatSettings> const&, std::optional<unsigned long>, std::optional<unsigned long>, bool, DB::CompressionMethod) const @ 0x000000003e122a15 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Context.cpp:3778: DB::Context::getInputFormat(String const&, DB::ReadBuffer&, DB::Block const&, unsigned long, std::optional<DB::FormatSettings> const&, std::optional<unsigned long>) const @ 0x00000000378f561c in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/StorageFile.cpp:0: DB::StorageFileSource::generate() @ 0x000000003bc65ddd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:03.969107 [ 2443 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:03.978924 [ 2782 ] {a284ecc0-f370-49bb-a1db-56d5cfbc5146} <Error> TCPHandler: Code: 107. DB::Exception: Cannot open CapnProto schema, file /var/lib/clickhouse/format_schemas/nonexist.capnp doesn't exists: While executing File. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Formats/CapnProtoSchema.cpp:47: DB::CapnProtoSchemaParser::getMessageSchema(DB::FormatSchemaInfo const&) @ 0x000000003e5463c6 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp:25: DB::CapnProtoRowInputFormat::CapnProtoRowInputFormat(DB::ReadBuffer&, DB::Block, DB::RowInputFormatParams, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema> const&, DB::FormatSettings const&) @ 0x000000003e53f5b1 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:0: DB::CapnProtoRowInputFormat* std::construct_at[abi:v15000]<DB::CapnProtoRowInputFormat, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema>, DB::FormatSettings const&, DB::CapnProtoRowInputFormat*>(DB::CapnProtoRowInputFormat*, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams&&, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema>&&, DB::FormatSettings const&) @ 0x000000003e544c43 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CapnProtoRowInputFormat> std::make_shared[abi:v15000]<DB::CapnProtoRowInputFormat, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema>, DB::FormatSettings const&, void>(DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams&&, DB::MaybeAutogeneratedFormatSchemaInfo<DB::StructureToCapnProtoSchema>&&, DB::FormatSettings const&) @ 0x000000003e54479a in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp:0: std::shared_ptr<DB::IInputFormat> std::__function::__policy_invoker<std::shared_ptr<DB::IInputFormat> (DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerInputFormatCapnProto(DB::FormatFactory&)::$_0, std::shared_ptr<DB::IInputFormat> (DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&)>>(std::__function::__policy_storage const*, DB::ReadBuffer&, DB::Block const&, DB::RowInputFormatParams const&, DB::FormatSettings const&) @ 0x000000003e543226 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::FormatFactory::getInput(String const&, DB::ReadBuffer&, DB::Block const&, std::shared_ptr<DB::Context const>, unsigned long, std::optional<DB::FormatSettings> const&, std::optional<unsigned long>, std::optional<unsigned long>, bool, DB::CompressionMethod) const @ 0x000000003e122a15 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Context.cpp:3778: DB::Context::getInputFormat(String const&, DB::ReadBuffer&, DB::Block const&, unsigned long, std::optional<DB::FormatSettings> const&, std::optional<unsigned long>) const @ 0x00000000378f561c in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/StorageFile.cpp:0: DB::StorageFileSource::generate() @ 0x000000003bc65ddd in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:03.979173 [ 3101 ] {f818b9f4-6e40-4abb-a040-72d10a732093} <Error> executeQuery: Code: 41. DB::Exception: Value 60 for second must be in the range [0, 59]: While processing parseDateTimeInJodaSyntax('60', 's', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('60', 's', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaSecondOfMinute(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfed09 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:35:03.995069 [ 3101 ] {f818b9f4-6e40-4abb-a040-72d10a732093} <Error> TCPHandler: Code: 41. DB::Exception: Value 60 for second must be in the range [0, 59]: While processing parseDateTimeInJodaSyntax('60', 's', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<int&>(int, FormatStringHelperImpl<std::type_identity<int&>::type>, int&) @ 0x000000001ad426f7 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaSecondOfMinute(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfed09 in /usr/bin/clickhouse
4. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
5. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:35:05.502465 [ 3101 ] {bb970aee-5372-46d7-9f19-5eb840920438} <Error> executeQuery: Code: 41. DB::Exception: Unable to parse fragment s from -1 because read number failed: While processing parseDateTimeInJodaSyntax('-1', 's', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('-1', 's', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaSecondOfMinute(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfeae8 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:35:05.503844 [ 2423 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:05.524752 [ 3101 ] {bb970aee-5372-46d7-9f19-5eb840920438} <Error> TCPHandler: Code: 41. DB::Exception: Unable to parse fragment s from -1 because read number failed: While processing parseDateTimeInJodaSyntax('-1', 's', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01c76 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaSecondOfMinute(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acfeae8 in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:35:05.695025 [ 3101 ] {1053ad34-8f9c-4c17-a48d-6d1794d8a6f2} <Error> executeQuery: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 's', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('123456789', 's', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:35:05.703341 [ 3101 ] {1053ad34-8f9c-4c17-a48d-6d1794d8a6f2} <Error> TCPHandler: Code: 41. DB::Exception: Invalid format input 123456789 is malformed at 3456789: While processing parseDateTimeInJodaSyntax('123456789', 's', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad40553 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001acef35b in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:35:07.144329 [ 2367 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:07.144428 [ 3101 ] {a824960b-d0b7-47a2-8f0e-ba2c15dfd922} <Error> executeQuery: Code: 41. DB::Exception: Unable to parse fragment CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC from  because max_digits_to_read is too big: While processing parseDateTimeInJodaSyntax('19191919191919191919191919191919', 'CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC', 'UTC'). (CANNOT_PARSE_DATETIME) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: -- integer overflow in AST Fuzzer
 select parseDateTimeInJodaSyntax('19191919191919191919191919191919', 'CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC', 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01e19 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaCenturyOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf709b in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:35:07.161963 [ 3101 ] {a824960b-d0b7-47a2-8f0e-ba2c15dfd922} <Error> TCPHandler: Code: 41. DB::Exception: Unable to parse fragment CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC from  because max_digits_to_read is too big: While processing parseDateTimeInJodaSyntax('19191919191919191919191919191919', 'CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC', 'UTC'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, String const&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000001ad47016 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::readNumberWithVariableLength(char const*, char const*, bool, bool, bool, unsigned long, unsigned long, String const&, int&) @ 0x000000001ad01e19 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::Instruction::jodaCenturyOfEra(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001acf709b in /usr/bin/clickhouse
5. char const* std::__function::__policy_invoker<char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>::__call_impl<std::__function::__default_alloc_func<std::__bind_front_t<char const* (*)(unsigned long, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&), unsigned long>, char const* (char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&)>>(std::__function::__policy_storage const*, char const*, char const*, String const&, DB::(anonymous namespace)::DateTime&) @ 0x000000001ad01324 in /usr/bin/clickhouse
6. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001aceddca in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:35:08.167132 [ 2339 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:09.705885 [ 2415 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:09.705903 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_60_65_1}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x000000002089312c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000002088e69d in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x00000000207ac6df in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ThreadFuzzer.cpp:242: DB::ThreadFuzzer::maybeInjectMemoryLimitException() @ 0x00000000209420d6 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003dacefcf in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc15 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:09.719883 [ 3101 ] {92d1a6c6-01ba-4321-9318-b7ddb04d6194} <Error> executeQuery: Code: 42. DB::Exception: Incorrect number of arguments for function parseDateTimeInJodaSyntax provided 1 (String), expected 2 to 3 ('time' : String, 'format' : String, ['timezone' : const String]): While processing parseDateTimeInJodaSyntax('12 AM'). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: -- Error handling
 select parseDateTimeInJodaSyntax('12 AM');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long, String, unsigned long, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, unsigned long&&, String&&, unsigned long&&, String&&, String&&, String&&) @ 0x00000000352f4818 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/FunctionHelpers.cpp:185: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352ecbac in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001acf2dc3 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:35:09.736120 [ 3101 ] {92d1a6c6-01ba-4321-9318-b7ddb04d6194} <Error> TCPHandler: Code: 42. DB::Exception: Incorrect number of arguments for function parseDateTimeInJodaSyntax provided 1 (String), expected 2 to 3 ('time' : String, 'format' : String, ['timezone' : const String]): While processing parseDateTimeInJodaSyntax('12 AM'). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long, String, unsigned long, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, unsigned long&&, String&&, unsigned long&&, String&&, String&&, String&&) @ 0x00000000352f4818 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/FunctionHelpers.cpp:185: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352ecbac in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001acf2dc3 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:35:09.811234 [ 3101 ] {d0de707a-acee-42c2-a2cd-178ab28e619d} <Error> executeQuery: Code: 42. DB::Exception: Incorrect number of arguments for function parseDateTimeInJodaSyntax provided 4 (String, String, String, String), expected 2 to 3 ('time' : String, 'format' : String, ['timezone' : const String]): While processing parseDateTimeInJodaSyntax('12 AM', 'h a', 'UTC', 'a fourth argument'). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36042) (comment: 02668_parse_datetime_in_joda_syntax.sql) (in query: select parseDateTimeInJodaSyntax('12 AM', 'h a', 'UTC', 'a fourth argument');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long, String, unsigned long, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, unsigned long&&, String&&, unsigned long&&, String&&, String&&, String&&) @ 0x00000000352f4818 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/FunctionHelpers.cpp:185: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352ecbac in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001acf2dc3 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:35:09.819953 [ 3101 ] {d0de707a-acee-42c2-a2cd-178ab28e619d} <Error> TCPHandler: Code: 42. DB::Exception: Incorrect number of arguments for function parseDateTimeInJodaSyntax provided 4 (String, String, String, String), expected 2 to 3 ('time' : String, 'format' : String, ['timezone' : const String]): While processing parseDateTimeInJodaSyntax('12 AM', 'h a', 'UTC', 'a fourth argument'). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String, unsigned long, String, unsigned long, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<unsigned long>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, unsigned long&&, String&&, unsigned long&&, String&&, String&&, String&&) @ 0x00000000352f4818 in /usr/bin/clickhouse
3. ./build_docker/./src/Functions/FunctionHelpers.cpp:185: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&, std::vector<DB::FunctionArgumentDescriptor, std::allocator<DB::FunctionArgumentDescriptor>> const&) @ 0x00000000352ecbac in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionParseDateTimeImpl<DB::(anonymous namespace)::NameParseDateTimeInJodaSyntax, (DB::(anonymous namespace)::ParseSyntax)1, (DB::(anonymous namespace)::ErrorHandling)0>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001acf2dc3 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:35:10.708362 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:11.710504 [ 2388 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:11.950336 [ 6598 ] {e06186fd-b48c-4045-af36-2b92cd3f76c4} <Error> executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46450) (in query: select _path,_file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:11.954465 [ 6598 ] {e06186fd-b48c-4045-af36-2b92cd3f76c4} <Error> TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:12.716839 [ 2465 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:13.728847 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:15.168634 [ 2326 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:16.514815 [ 2466 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x00000000208396b7 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x000000003faa83d6 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x000000003fb2f3bc in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x000000003fb3959f in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa26a62 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa25ba6 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa28087 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:255: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa27d8a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr<zkutil::ZooKeeper>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x000000003d88d35c in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3252: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000003c0bbe2d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_2, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e1f in /usr/bin/clickhouse
13. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
15. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:18.597287 [ 3139 ] {74360fd4-a8a8-4b0e-a93e-1dd185429a7f} <Error> executeQuery: Code: 999. Coordination::Exception: Session expired (fault injected on send). (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38794) (comment: 01293_system_distribution_queue.sql) (in query: DROP DATABASE IF EXISTS test_mz35ppxr ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [41]>(int, char const (&) [41]) @ 0x00000000151622f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage<char const (&) [41]>(Coordination::Error, char const (&) [41]) @ 0x000000003d976236 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1526: Coordination::ZooKeeper::maybeInjectSendFault() @ 0x000000003fb2fc6f in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x000000003fb2ee9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x000000003fb3959f in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa26a62 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa25ba6 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa28087 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x000000003fa2732d in /usr/bin/clickhouse
11. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:709: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003fa3fddb in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1548: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003fa41ab6 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1548: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003fa41ab6 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1548: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003fa41ab6 in /usr/bin/clickhouse
15. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:436: zkutil::ZooKeeper::tryRemoveRecursive(String const&) @ 0x000000003fa45b6a in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::drop(std::shared_ptr<DB::Context const>) @ 0x00000000371800b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::detachDatabase(std::shared_ptr<DB::Context const>, String const&, bool, bool) @ 0x0000000037adaff4 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:396: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x0000000039651b83 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000039645d0d in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643f56 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
24. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
25. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:35:18.601365 [ 2347 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:18.604326 [ 2335 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:18.616339 [ 3139 ] {74360fd4-a8a8-4b0e-a93e-1dd185429a7f} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Session expired (fault injected on send). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [41]>(int, char const (&) [41]) @ 0x00000000151622f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage<char const (&) [41]>(Coordination::Error, char const (&) [41]) @ 0x000000003d976236 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1526: Coordination::ZooKeeper::maybeInjectSendFault() @ 0x000000003fb2fc6f in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x000000003fb2ee9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x000000003fb3959f in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa26a62 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa25ba6 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa28087 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x000000003fa2732d in /usr/bin/clickhouse
11. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:709: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003fa3fddb in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1548: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003fa41ab6 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1548: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003fa41ab6 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1548: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003fa41ab6 in /usr/bin/clickhouse
15. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:436: zkutil::ZooKeeper::tryRemoveRecursive(String const&) @ 0x000000003fa45b6a in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::drop(std::shared_ptr<DB::Context const>) @ 0x00000000371800b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::detachDatabase(std::shared_ptr<DB::Context const>, String const&, bool, bool) @ 0x0000000037adaff4 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:396: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x0000000039651b83 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000039645d0d in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643f56 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
24. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
25. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:20.129858 [ 2415 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:20.131660 [ 2342 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:20.135141 [ 3232 ] {d5ebc285-6723-438e-a604-9276bc8eb83c} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56624) (comment: 01431_finish_sorting_with_consts.sql) (in query: CREATE DATABASE IF NOT EXISTS test_i2w2ln2w ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:20.960270 [ 3232 ] {d5ebc285-6723-438e-a604-9276bc8eb83c} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:20.960406 [ 2759 ] {5e09bad4-c3d9-48e2-bc27-d236d90aee9e} <Error> executeQuery: Code: 43. DB::Exception: Third argument of function dictHas must be tuple when dictionary is complex and key contains more than 1 attribute.Actual type String.: While processing dictHas('01280_db.ssd_dict', 'a', tuple('1')). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60980) (comment: 01280_ssd_complex_key_dictionary.sh) (in query: SELECT dictHas('01280_db.ssd_dict', 'a', tuple('1'));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionDictHas::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ae80339 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:35:20.970763 [ 2759 ] {5e09bad4-c3d9-48e2-bc27-d236d90aee9e} <Error> TCPHandler: Code: 43. DB::Exception: Third argument of function dictHas must be tuple when dictionary is complex and key contains more than 1 attribute.Actual type String.: While processing dictHas('01280_db.ssd_dict', 'a', tuple('1')). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionDictHas::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ae80339 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:35:21.131008 [ 2388 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:21.137660 [ 2375 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:21.138391 [ 3232 ] {a98bdbcc-98a4-4f23-b259-b938fe411760} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56638) (comment: 00945_bloom_filter_index.sql) (in query: CREATE DATABASE IF NOT EXISTS test_0ht9qpai ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:21.159040 [ 3232 ] {a98bdbcc-98a4-4f23-b259-b938fe411760} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:21.511550 [ 2759 ] {a8a2038d-9b00-48f6-8173-ac8e3385f589} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56648) (comment: 02725_cnf_large_check.sql) (in query: CREATE DATABASE IF NOT EXISTS test_8ux7828d ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:21.533560 [ 2759 ] {a8a2038d-9b00-48f6-8173-ac8e3385f589} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:21.797956 [ 2759 ] {e2e6efd9-6662-431f-951d-73081cc44327} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56652) (comment: 01351_geohash_assert.sql) (in query: CREATE DATABASE IF NOT EXISTS test_e3vhz5ja ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:21.810862 [ 2759 ] {e2e6efd9-6662-431f-951d-73081cc44327} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:21.954078 [ 2759 ] {a2958629-7c7a-40e7-b744-31fa63e22067} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56662) (comment: 01804_dictionary_decimal256_type.sql) (in query: CREATE DATABASE IF NOT EXISTS test_26xo9n7h ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:21.982334 [ 2759 ] {a2958629-7c7a-40e7-b744-31fa63e22067} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:22.137253 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:22.146673 [ 2432 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:22.277119 [ 2759 ] {8462534e-2241-4471-9721-d8bf466848af} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56678) (comment: 00620_optimize_on_nonleader_replica_zookeeper.sql) (in query: CREATE DATABASE IF NOT EXISTS test_xl6ohyi9 ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:22.281588 [ 2759 ] {8462534e-2241-4471-9721-d8bf466848af} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:22.510300 [ 2759 ] {da3cd036-0722-4495-bdb6-2148f101eae0} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56684) (comment: 02771_jit_functions_comparison_crash.sql) (in query: CREATE DATABASE IF NOT EXISTS test_m82r9vfw ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:22.518456 [ 2759 ] {da3cd036-0722-4495-bdb6-2148f101eae0} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:22.731941 [ 2759 ] {7b091014-5ac4-478f-8015-17d23bfb8d77} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56692) (comment: 01647_clickhouse_local_hung.sh) (in query: CREATE DATABASE IF NOT EXISTS test_ccs4klre ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:22.763104 [ 2759 ] {7b091014-5ac4-478f-8015-17d23bfb8d77} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:23.123280 [ 2759 ] {e11f5971-565d-4121-adae-a17ef6244b74} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56702) (comment: 02393_every_metric_must_have_documentation.sql) (in query: CREATE DATABASE IF NOT EXISTS test_gszox4p6 ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:23.137711 [ 2759 ] {e11f5971-565d-4121-adae-a17ef6244b74} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:23.137952 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:23.147216 [ 2456 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:23.414975 [ 2759 ] {f4d020c8-9215-413d-95a4-9d42a741e419} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56710) (comment: 01050_clickhouse_dict_source_with_subquery.sql) (in query: CREATE DATABASE IF NOT EXISTS test_i8jnp5lv ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:23.442575 [ 2759 ] {f4d020c8-9215-413d-95a4-9d42a741e419} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:23.649541 [ 3232 ] {58f9e030-2b2b-46ca-bbcc-2438f921aa9c} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56726) (comment: 02469_interval_msan.sql) (in query: CREATE DATABASE IF NOT EXISTS test_gqtm8ssa ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:23.667436 [ 3232 ] {58f9e030-2b2b-46ca-bbcc-2438f921aa9c} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:24.071498 [ 3186 ] {bfcbe956-4610-4bd0-8949-3bb3936a0d6b} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56742) (comment: 00464_sort_all_constant_columns.sql) (in query: CREATE DATABASE IF NOT EXISTS test_n7xhevw9 ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:24.092544 [ 3186 ] {bfcbe956-4610-4bd0-8949-3bb3936a0d6b} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:24.141132 [ 2351 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:24.151317 [ 2349 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:24.722819 [ 2751 ] {8f73f307-b5f9-4b27-9867-3648b0c9faf0} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56748) (comment: 01889_check_row_policy_defined_using_user_function.sh) (in query: CREATE DATABASE IF NOT EXISTS test_tm5prwjh ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:24.733516 [ 2751 ] {8f73f307-b5f9-4b27-9867-3648b0c9faf0} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:24.942221 [ 2751 ] {686eae0a-6218-45a7-8982-1836c7fbe50c} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41314) (comment: 01563_distributed_query_finish.sh) (in query: CREATE DATABASE IF NOT EXISTS test_s17ke6h1 ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:24.981915 [ 2751 ] {686eae0a-6218-45a7-8982-1836c7fbe50c} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:25.141905 [ 2365 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:25.154900 [ 2422 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:25.355699 [ 2751 ] {cba24c64-23b3-4c56-a208-0f2926821d32} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41320) (comment: 00316_rounding_functions_and_empty_block.sql) (in query: CREATE DATABASE IF NOT EXISTS test_ipi50yvl ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:25.365141 [ 2751 ] {cba24c64-23b3-4c56-a208-0f2926821d32} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:25.742090 [ 6601 ] {b1afa7da-c988-4a67-8911-8fd6b3c26a90} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41350) (comment: 00074_full_join.sql) (in query: CREATE DATABASE IF NOT EXISTS test_pzsq6j1j ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:25.763615 [ 6601 ] {b1afa7da-c988-4a67-8911-8fd6b3c26a90} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:26.099849 [ 6601 ] {3a30d659-7b39-4d19-b87e-f19ca1dc0d67} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41354) (comment: 00081_group_by_without_key_and_totals.sql) (in query: CREATE DATABASE IF NOT EXISTS test_05x6p3x5 ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:26.117015 [ 6601 ] {3a30d659-7b39-4d19-b87e-f19ca1dc0d67} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:26.190673 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:26.193772 [ 2464 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:28.313644 [ 6601 ] {a9ca483f-9393-4609-b352-a4f2d1e77a07} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41356) (comment: 00059_merge_sorting_empty_array_joined.sql) (in query: CREATE DATABASE IF NOT EXISTS test_5i5ckbss ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:28.318759 [ 2347 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:28.318772 [ 2332 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:28.330049 [ 6601 ] {a9ca483f-9393-4609-b352-a4f2d1e77a07} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:28.334886 [ 2751 ] {ce33f339-54f4-4d9d-918c-d9d37f5488e7} <Error> executeQuery: Code: 53. DB::Exception: Dictionary `01280_db`.ssd_dict key lookup structure does not match, expected (String, Int32): While processing dictGetUInt64('01280_db.ssd_dict', 'a', tuple(toInt32(3))). (TYPE_MISMATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34226) (comment: 01280_ssd_complex_key_dictionary.sh) (in query: SELECT dictGetUInt64('01280_db.ssd_dict', 'a', tuple(toInt32(3)));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Dictionaries/IDictionary.h:146: DB::IDictionary::convertKeyColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>>&) const @ 0x000000002b2aaad6 in /usr/bin/clickhouse
4. DB::FunctionDictGetNoType<(DB::DictionaryGetFunctionType)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ae4e8a9 in /usr/bin/clickhouse
5. DB::FunctionDictGetImpl<DB::DataTypeNumber<unsigned long>, DB::NameDictGetUInt64, (DB::DictionaryGetFunctionType)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ae9b28a in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:35:28.347375 [ 2751 ] {ce33f339-54f4-4d9d-918c-d9d37f5488e7} <Error> TCPHandler: Code: 53. DB::Exception: Dictionary `01280_db`.ssd_dict key lookup structure does not match, expected (String, Int32): While processing dictGetUInt64('01280_db.ssd_dict', 'a', tuple(toInt32(3))). (TYPE_MISMATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Dictionaries/IDictionary.h:146: DB::IDictionary::convertKeyColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>>&) const @ 0x000000002b2aaad6 in /usr/bin/clickhouse
4. DB::FunctionDictGetNoType<(DB::DictionaryGetFunctionType)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ae4e8a9 in /usr/bin/clickhouse
5. DB::FunctionDictGetImpl<DB::DataTypeNumber<unsigned long>, DB::NameDictGetUInt64, (DB::DictionaryGetFunctionType)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ae9b28a in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:35:28.577811 [ 6601 ] {bd6584a1-38d3-4afe-bffa-d9b57cb276fc} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41358) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: CREATE DATABASE IF NOT EXISTS test_6eh52vtd ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:28.599446 [ 6601 ] {bd6584a1-38d3-4afe-bffa-d9b57cb276fc} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:28.786544 [ 2751 ] {81e94a01-6b3c-4bc2-aaa3-9ff4cfead1c1} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41364) (comment: 00140_rename.sql) (in query: CREATE DATABASE IF NOT EXISTS test_mmf6yp83 ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:28.882636 [ 2751 ] {81e94a01-6b3c-4bc2-aaa3-9ff4cfead1c1} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:29.088571 [ 2751 ] {6c03b965-772b-4017-b56f-8bea28dfc1a6} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41368) (comment: 00032_aggregate_key64.sql) (in query: CREATE DATABASE IF NOT EXISTS test_k0ss647u ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:29.114433 [ 2751 ] {6c03b965-772b-4017-b56f-8bea28dfc1a6} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:29.325754 [ 2336 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:29.325778 [ 2354 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:29.475875 [ 3186 ] {09939883-1219-49c2-8661-b9009935bfe6} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41380) (comment: 00172_hits_joins.gen.sql) (in query: CREATE DATABASE IF NOT EXISTS test_42bxktao ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:29.489823 [ 3186 ] {09939883-1219-49c2-8661-b9009935bfe6} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:29.801189 [ 3186 ] {e0bd104a-931e-4f28-9353-46ddb94f298f} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41394) (comment: 00054_merge_tree_partitions.sql) (in query: CREATE DATABASE IF NOT EXISTS test_enmz0lap ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:29.805860 [ 3186 ] {e0bd104a-931e-4f28-9353-46ddb94f298f} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:30.079355 [ 6598 ] {c9e290ad-7916-492a-ba1d-43049e743ad3} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41404) (comment: 00047_bar.sql) (in query: CREATE DATABASE IF NOT EXISTS test_vr2ope1l ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:30.087218 [ 6598 ] {c9e290ad-7916-492a-ba1d-43049e743ad3} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:30.326795 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:30.328860 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:30.516234 [ 6598 ] {960d19e2-f7eb-4852-a982-db192340697d} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41412) (comment: 00063_loyalty_joins.sql) (in query: CREATE DATABASE IF NOT EXISTS test_c133wbvj ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:30.522962 [ 6598 ] {960d19e2-f7eb-4852-a982-db192340697d} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:30.648169 [ 3186 ] {1e794e2d-840c-454c-94e9-c0f5bd284fd9} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41426) (comment: 00066_sorting_distributed_many_replicas.sql) (in query: CREATE DATABASE IF NOT EXISTS test_497tahjc ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:30.678914 [ 3186 ] {1e794e2d-840c-454c-94e9-c0f5bd284fd9} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:30.876461 [ 3186 ] {8738b84b-b7cc-4269-8a49-df1c8e74d21c} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41428) (comment: 00175_obfuscator_schema_inference.sh) (in query: CREATE DATABASE IF NOT EXISTS test_0gpv2081 ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:30.883470 [ 3186 ] {8738b84b-b7cc-4269-8a49-df1c8e74d21c} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:31.208582 [ 3186 ] {5bd30132-6a07-4cb1-85e9-f0d7d520c407} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41440) (comment: 00049_max_string_if.sql) (in query: CREATE DATABASE IF NOT EXISTS test_watz5bev ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:31.218741 [ 3186 ] {5bd30132-6a07-4cb1-85e9-f0d7d520c407} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:31.330014 [ 2397 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:31.332540 [ 2403 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:31.427516 [ 3239 ] {79d6285c-9b52-4713-aa58-c6524d9c71b6} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41442) (comment: 00031_array_enumerate_uniq.sql) (in query: CREATE DATABASE IF NOT EXISTS test_4kw228ck ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:31.437066 [ 3239 ] {79d6285c-9b52-4713-aa58-c6524d9c71b6} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:31.610075 [ 3239 ] {8f8bcac2-2c63-4ae2-a375-f77abe558871} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41444) (comment: 00046_uniq_upto_distributed.sql) (in query: CREATE DATABASE IF NOT EXISTS test_uah6w8wk ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:31.630690 [ 3239 ] {8f8bcac2-2c63-4ae2-a375-f77abe558871} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:31.837015 [ 3239 ] {1d486171-3604-4740-8052-7bd4af3f0ca4} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41452) (comment: 00052_group_by_in.sql) (in query: CREATE DATABASE IF NOT EXISTS test_qj2jcwfn ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:31.852267 [ 3239 ] {1d486171-3604-4740-8052-7bd4af3f0ca4} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:32.316651 [ 3239 ] {a3b0e539-5707-461e-914c-a65f140ad93d} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41456) (comment: 00004_top_counters.sql) (in query: CREATE DATABASE IF NOT EXISTS test_de103r3q ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:32.336347 [ 2430 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:32.343021 [ 2381 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:32.391969 [ 3239 ] {a3b0e539-5707-461e-914c-a65f140ad93d} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:32.663068 [ 3186 ] {ffdd355a-a2fc-4ea7-a3ce-47cb49ef5006} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41460) (comment: 00167_read_bytes_from_fs.sql) (in query: CREATE DATABASE IF NOT EXISTS test_fw25grrn ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:32.670968 [ 3186 ] {ffdd355a-a2fc-4ea7-a3ce-47cb49ef5006} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:33.167219 [ 2751 ] {a641a1cb-92e2-4252-9c07-a8ec64588fd7} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41474) (comment: 00005_filtering.sql) (in query: CREATE DATABASE IF NOT EXISTS test_wo2y09ip ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:33.175743 [ 2751 ] {a641a1cb-92e2-4252-9c07-a8ec64588fd7} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:33.349045 [ 2462 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:33.349467 [ 2355 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:33.397801 [ 2751 ] {e847a393-b710-4426-9e8a-31931e7ba5cc} <Error> executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41478) (comment: 00021_3_select_with_in.sql) (in query: CREATE DATABASE IF NOT EXISTS test_go12tzgc ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:33.425994 [ 2751 ] {e847a393-b710-4426-9e8a-31931e7ba5cc} <Error> DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_14/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x000000000a8460d8 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa56825 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1276: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa57415 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector<std::shared_ptr<Coordination::Request>, std::allocator<std::shared_ptr<Coordination::Request>>> const&, std::vector<std::shared_ptr<Coordination::Response>, std::allocator<std::shared_ptr<Coordination::Response>>> const&) @ 0x000000003fa347b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x000000003713db2e in /usr/bin/clickhouse
7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000003713332c in /usr/bin/clickhouse
8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x00000000371444d9 in /usr/bin/clickhouse
9. ./build_docker/./src/Databases/TablesLoader.cpp:62: DB::TablesLoader::loadTables() @ 0x000000003962e24c in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939ba2d in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:34.355084 [ 2467 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:34.355201 [ 2367 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:35.359224 [ 2464 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:35.373707 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:36.361319 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:36.375342 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:37.368781 [ 2317 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:37.380074 [ 2324 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:38.370656 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:38.476334 [ 2419 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:39.382469 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:39.476973 [ 2433 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:40.388055 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:40.478006 [ 2425 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:41.933686 [ 2440 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:41.935290 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:41.942906 [ 4381 ] {eef7e141-7381-4aba-a7c2-e5d60a704d2f} <Error> executeQuery: Code: 264. DB::Exception: Table test.join (940402bd-5467-41f9-8135-0636a0ee5400) needs the same join_use_nulls setting as present in LEFT or FULL JOIN. (INCOMPATIBLE_TYPE_OF_JOIN) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50370) (comment: 00065_loyalty_with_storage_join.sql) (in query: SELECT loyalty, count() FROM hits SEMI LEFT JOIN join USING UserID GROUP BY loyalty ORDER BY loyalty ASC;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageJoin.cpp:189: DB::StorageJoin::getJoinLocked(std::shared_ptr<DB::TableJoin>, std::shared_ptr<DB::Context const>, std::vector<String, std::allocator<String>> const&) const @ 0x000000003bcd8a84 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbe784 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:41.960540 [ 4381 ] {eef7e141-7381-4aba-a7c2-e5d60a704d2f} <Error> TCPHandler: Code: 264. DB::Exception: Table test.join (940402bd-5467-41f9-8135-0636a0ee5400) needs the same join_use_nulls setting as present in LEFT or FULL JOIN. (INCOMPATIBLE_TYPE_OF_JOIN), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageJoin.cpp:189: DB::StorageJoin::getJoinLocked(std::shared_ptr<DB::TableJoin>, std::shared_ptr<DB::Context const>, std::vector<String, std::allocator<String>> const&) const @ 0x000000003bcd8a84 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbe784 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:42.944853 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:42.946901 [ 2457 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:43.954494 [ 2454 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:43.954542 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:44.956042 [ 2434 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:44.956651 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:45.964776 [ 2341 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:45.966470 [ 2348 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:46.972490 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:46.991231 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:47.991771 [ 2459 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:47.995081 [ 2347 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:48.994053 [ 2390 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:48.996559 [ 2424 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:49.994957 [ 2394 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:49.999961 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:50.999475 [ 2368 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:51.023374 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:52.023488 [ 2395 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:52.026735 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:53.716406 [ 2413 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:53.716408 [ 2457 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:53.719374 [ 3991 ] {ac335503-b435-41e1-bc1e-38e64e479256} <Error> executeQuery: Code: 582. DB::Exception: There is no projection pToDro in table. Maybe you meant: ['pToDrop']. (NO_SUCH_PROJECTION_IN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59064) (comment: 02250_hints_for_projections.sh) (in query: ALTER TABLE t DROP PROJECTION pToDro), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000bfd4275 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/ProjectionsDescription.cpp:403: DB::ProjectionsDescription::remove(String const&, bool) @ 0x000000003baac83f in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/AlterCommands.cpp:609: DB::AlterCommand::apply(DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context const>) const @ 0x000000003b90b697 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::AlterCommands::apply(DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context const>) const @ 0x000000003b91d6c9 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3145: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr<DB::Context const>) const @ 0x000000003cecfa82 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fad13 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:53.733171 [ 3991 ] {ac335503-b435-41e1-bc1e-38e64e479256} <Error> TCPHandler: Code: 582. DB::Exception: There is no projection pToDro in table. Maybe you meant: ['pToDrop']. (NO_SUCH_PROJECTION_IN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000bfd4275 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/ProjectionsDescription.cpp:403: DB::ProjectionsDescription::remove(String const&, bool) @ 0x000000003baac83f in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/AlterCommands.cpp:609: DB::AlterCommand::apply(DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context const>) const @ 0x000000003b90b697 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::AlterCommands::apply(DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context const>) const @ 0x000000003b91d6c9 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3145: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr<DB::Context const>) const @ 0x000000003cecfa82 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fad13 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:35:54.725172 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:54.727254 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:55.732346 [ 2439 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:55.732429 [ 2353 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:56.734204 [ 2317 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:56.736433 [ 2325 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:57.746766 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:57.763951 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:58.757473 [ 2350 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:58.771935 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:59.758361 [ 2369 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:35:59.772893 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:00.771980 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:00.775072 [ 2332 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:01.776994 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:01.783534 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:02.783030 [ 2430 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:02.785673 [ 2376 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:03.793181 [ 2454 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:03.798126 [ 2413 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:04.795291 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:04.807269 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:06.755962 [ 3983 ] {105e2b07-be3d-4e47-ae57-6827cd24ec95} <Error> executeQuery: Code: 48. DB::Exception: Only `hash` join supports multiple ORs for keys in JOIN ON section. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36506) (comment: 02475_join_bug_42832.sql) (in query: SELECT sum(val), count(val) FROM tab1 FULL OUTER JOIN tab2 ON b1 - 2 = a2 OR a1 = b2 SETTINGS join_use_nulls = 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [67]>(int, char const (&) [67]) @ 0x000000001ce7ea97 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a703f81 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:06.763479 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:06.763512 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:06.772374 [ 3983 ] {105e2b07-be3d-4e47-ae57-6827cd24ec95} <Error> TCPHandler: Code: 48. DB::Exception: Only `hash` join supports multiple ORs for keys in JOIN ON section. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [67]>(int, char const (&) [67]) @ 0x000000001ce7ea97 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr<DB::IAST>&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector<DB::TableWithColumnNamesAndTypes, std::allocator<DB::TableWithColumnNamesAndTypes>> const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::TableJoin>) const @ 0x000000003a703f81 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b3a481 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:07.766650 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:07.766940 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:08.769569 [ 2433 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:08.770329 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:09.771199 [ 2465 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:09.771266 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:10.771941 [ 2440 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:10.772084 [ 2377 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:12.175845 [ 2751 ] {446c6e74-e796-418a-9aaa-8978029c3ad4} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:58346) (comment: 02785_date_predicate_optimizations_ast_query_tree_rewrite.sql) (in query: EXPLAIN QUERY TREE run_passes=1 SELECT value1 FROM date_t WHERE toYear(date1) = 1993 AND id BETWEEN 1 AND 3 SETTINGS allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:0: DB::InterpreterSetQuery::executeForCurrentContext(bool) @ 0x0000000039d96a79 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSetQuery.h:14: DB::applySettingsFromSelectWithUnion(DB::ASTSelectWithUnionQuery const&, std::shared_ptr<DB::Context>) @ 0x0000000039d99be8 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:64: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x0000000039d97c44 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:71: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x0000000039d9892c in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a998da3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:13.464731 [ 2423 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:13.464939 [ 2460 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:13.465115 [ 2751 ] {446c6e74-e796-418a-9aaa-8978029c3ad4} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:0: DB::InterpreterSetQuery::executeForCurrentContext(bool) @ 0x0000000039d96a79 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSetQuery.h:14: DB::applySettingsFromSelectWithUnion(DB::ASTSelectWithUnionQuery const&, std::shared_ptr<DB::Context>) @ 0x0000000039d99be8 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:64: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x0000000039d97c44 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:71: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x0000000039d9892c in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a998da3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:13.465773 [ 3232 ] {05e7958b-b2de-4aad-a914-165e4d8b063b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 20.28 MiB (attempt to allocate chunk of 1572864 bytes), maximum: 19.07 MiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:36520) (comment: 01655_plan_optimizations_optimize_read_in_window_order_long.sh) (in query: select n, sum(x) OVER (PARTITION BY n ORDER BY x ROWS BETWEEN 100 PRECEDING AND CURRENT ROW) from test_01655_plan_optimizations_optimize_read_in_window_order_long_n_x SETTINGS optimize_read_in_order=0, optimize_read_in_window_order=0, max_memory_usage=20000000, max_threads=1 format Null), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:13.466690 [ 18777 ] {71bf8afc-6aa5-4fb1-b33b-a9dc28b9073c} <Error> ExternalDictionariesLoader: Could not load external dictionary 'e5742b95-e764-45f3-9bc2-42520c803fdc', next update is scheduled at 2024-09-24 02:36:16: Code: 396. DB::Exception: Limit for result exceeded, max bytes: 1.00 B, current bytes: 36.00 B. (TOO_MANY_ROWS_OR_BYTES), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Transforms/LimitsCheckingTransform.cpp:45: DB::LimitsCheckingTransform::transform(DB::Chunk&) @ 0x000000003ebd8e2b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
13. DB::FlatDictionary::loadData() @ 0x000000002b2d760b in /usr/bin/clickhouse
14. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
15. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryFlat(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002b337c6f in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
17. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:13.985689 [ 3239 ] {30a52d21-270f-4eae-bab4-2ec8b6ebedf6} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1073741824 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: while executing 'FUNCTION randomPrintableASCII(102400 :: 2) -> randomPrintableASCII(102400) String : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59060) (comment: 01605_adaptive_granularity_block_borders.sql) (in query: -- There are about 900 marks for our settings.
 INSERT INTO adaptive_table SELECT number, if(number > 700, randomPrintableASCII(102400), randomPrintableASCII(1)) FROM numbers(10000);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:169: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3322 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001ca73a41 in /usr/bin/clickhouse
11. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
14. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:13.991096 [ 3232 ] {05e7958b-b2de-4aad-a914-165e4d8b063b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 20.28 MiB (attempt to allocate chunk of 1572864 bytes), maximum: 19.07 MiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:13.992969 [ 3983 ] {71bf8afc-6aa5-4fb1-b33b-a9dc28b9073c} <Error> executeQuery: Code: 396. DB::Exception: Limit for result exceeded, max bytes: 1.00 B, current bytes: 36.00 B: While processing dictGetUInt64('ordinary_db.dict1', 'second_column', toUInt64(100500)). (TOO_MANY_ROWS_OR_BYTES) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:58302) (comment: 01259_dictionary_custom_settings_ddl.sql) (in query: SELECT dictGetUInt64('ordinary_db.dict1', 'second_column', toUInt64(100500));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Transforms/LimitsCheckingTransform.cpp:45: DB::LimitsCheckingTransform::transform(DB::Chunk&) @ 0x000000003ebd8e2b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
13. DB::FlatDictionary::loadData() @ 0x000000002b2d760b in /usr/bin/clickhouse
14. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
15. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryFlat(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002b337c6f in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
17. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:14.046926 [ 3983 ] {71bf8afc-6aa5-4fb1-b33b-a9dc28b9073c} <Error> TCPHandler: Code: 396. DB::Exception: Limit for result exceeded, max bytes: 1.00 B, current bytes: 36.00 B: While processing dictGetUInt64('ordinary_db.dict1', 'second_column', toUInt64(100500)). (TOO_MANY_ROWS_OR_BYTES), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000036ac7e57 in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000036ac727c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000036ac746c in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Transforms/LimitsCheckingTransform.cpp:45: DB::LimitsCheckingTransform::transform(DB::Chunk&) @ 0x000000003ebd8e2b in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
13. DB::FlatDictionary::loadData() @ 0x000000002b2d760b in /usr/bin/clickhouse
14. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
15. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryFlat(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002b337c6f in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
17. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:14.049179 [ 3239 ] {30a52d21-270f-4eae-bab4-2ec8b6ebedf6} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1073741824 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: while executing 'FUNCTION randomPrintableASCII(102400 :: 2) -> randomPrintableASCII(102400) String : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:169: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3322 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001ca73a41 in /usr/bin/clickhouse
11. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
14. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:14.475304 [ 2317 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:14.482848 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:16.590333 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:16.590429 [ 3993 ] {c79d2507-7b8a-48e6-a946-925e0a601220} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 1.14 MiB (attempt to allocate chunk of 1199944 bytes), maximum: 9.31 GiB: Cache info: Buffer path: common/bam/kysguluthdpqdnxtlpmqnijeiqgcl, hash key: ef66e116c30dc3f3543c8c47a63f0548, file_offset_of_buffer_end: 90834, read_until_position: 101623, internal buffer end: 118474, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: c79d2507-7b8a-48e6-a946-925e0a601220:18344, file segment info: File segment: [0, 118473], key: ef66e116c30dc3f3543c8c47a63f0548, state: DOWNLOADING, downloaded size: 0, reserved size: 90834, downloader id: c79d2507-7b8a-48e6-a946-925e0a601220:18344, current write offset: 0, caller id: c79d2507-7b8a-48e6-a946-925e0a601220:18344, kind: Regular, unbound: 0: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_8_8_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 30 with max_rows_to_read = 6867): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52498) (comment: 00024_random_counters.sql) (in query: SELECT uniq(UserID), sum(Sign) FROM test.visits WHERE CounterID = 31982180;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
10. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000003579aea6 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a96c6 in /usr/bin/clickhouse
19. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:36:16.590742 [ 2342 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:16.867025 [ 3993 ] {c79d2507-7b8a-48e6-a946-925e0a601220} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 1.14 MiB (attempt to allocate chunk of 1199944 bytes), maximum: 9.31 GiB: Cache info: Buffer path: common/bam/kysguluthdpqdnxtlpmqnijeiqgcl, hash key: ef66e116c30dc3f3543c8c47a63f0548, file_offset_of_buffer_end: 90834, read_until_position: 101623, internal buffer end: 118474, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: c79d2507-7b8a-48e6-a946-925e0a601220:18344, file segment info: File segment: [0, 118473], key: ef66e116c30dc3f3543c8c47a63f0548, state: DOWNLOADING, downloaded size: 0, reserved size: 90834, downloader id: c79d2507-7b8a-48e6-a946-925e0a601220:18344, current write offset: 0, caller id: c79d2507-7b8a-48e6-a946-925e0a601220:18344, kind: Regular, unbound: 0: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_8_8_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 30 with max_rows_to_read = 6867): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
10. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000003579aea6 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a96c6 in /usr/bin/clickhouse
19. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:36:17.591148 [ 2398 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:17.595726 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:18.606114 [ 2442 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:18.606459 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:19.607222 [ 2454 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:19.614855 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:20.610349 [ 2434 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:20.617464 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:21.612254 [ 2353 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:21.621712 [ 2384 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:22.614360 [ 2407 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:22.622492 [ 2459 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:23.512261 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 5181838 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f47322 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:23.512323 [ 2782 ] {test_5_test_02585_query_to_kill_id_1} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1056672 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56714) (comment: 02585_query_status_deadlock.sh) (in query: create temporary table tmp as select * from numbers(500000000);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x0000000034b5779a in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:23.717637 [ 2375 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:23.717991 [ 2404 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:24.399006 [ 2782 ] {test_5_test_02585_query_to_kill_id_1} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1056672 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x0000000034b5779a in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:24.718644 [ 2332 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:24.719444 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:25.730940 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:25.731547 [ 2442 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:28.645796 [ 2382 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:28.646439 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:28.967948 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_1_65_9}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationLowCardinality::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f47705 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed7d42 in /usr/bin/clickhouse
25. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
26. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:29.651648 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:29.662199 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:30.662263 [ 2388 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:30.663827 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:31.118422 [ 4381 ] {d1353379-f0a7-46d2-a7dc-a62511c8de59} <Error> executeQuery: Code: 59. DB::Exception: Illegal type Float64 of column modulo(sipHash64(sipHash64(p, toString(toDate(p))), toString(toDate(p))), -0.) for filter. Must be UInt8 or Nullable(UInt8). (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47970) (comment: 02680_illegal_type_of_filter_projection.sql) (in query: SELECT count() FROM test_tuple PREWHERE sipHash64(sipHash64(p, toString(toDate(p))), toString(toDate(p))) % -0. WHERE i > NULL settings optimize_trivial_count_query=0, optimize_use_implicit_projections=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:91: DB::QueryPlanOptimizations::findInOutputs(DB::ActionsDAG&, String const&, bool) @ 0x000000003f3d0fc1 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:134: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d17c5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:147: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d197f in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:147: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d197f in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:0: DB::QueryPlanOptimizations::QueryDAG::build(DB::QueryPlan::Node&) @ 0x000000003f3d2130 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeUseAggregateProjection.cpp:460: DB::QueryPlanOptimizations::getAggregateProjectionCandidates(DB::QueryPlan::Node&, DB::AggregatingStep&, DB::ReadFromMergeTree&, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>> const&, bool) @ 0x000000003f3adfb6 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeUseAggregateProjection.cpp:0: DB::QueryPlanOptimizations::optimizeUseAggregateProjections(DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&, bool) @ 0x000000003f3b4467 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:135: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31d2d4 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:31.123058 [ 4381 ] {d1353379-f0a7-46d2-a7dc-a62511c8de59} <Error> TCPHandler: Code: 59. DB::Exception: Illegal type Float64 of column modulo(sipHash64(sipHash64(p, toString(toDate(p))), toString(toDate(p))), -0.) for filter. Must be UInt8 or Nullable(UInt8). (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:91: DB::QueryPlanOptimizations::findInOutputs(DB::ActionsDAG&, String const&, bool) @ 0x000000003f3d0fc1 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:134: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d17c5 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:147: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d197f in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:147: DB::QueryPlanOptimizations::QueryDAG::buildImpl(DB::QueryPlan::Node&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>&) @ 0x000000003f3d197f in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/Optimizations/projectionsCommon.cpp:0: DB::QueryPlanOptimizations::QueryDAG::build(DB::QueryPlan::Node&) @ 0x000000003f3d2130 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeUseAggregateProjection.cpp:460: DB::QueryPlanOptimizations::getAggregateProjectionCandidates(DB::QueryPlan::Node&, DB::AggregatingStep&, DB::ReadFromMergeTree&, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>> const&, bool) @ 0x000000003f3adfb6 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeUseAggregateProjection.cpp:0: DB::QueryPlanOptimizations::optimizeUseAggregateProjections(DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&, bool) @ 0x000000003f3b4467 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/Optimizations/optimizeTree.cpp:135: DB::QueryPlanOptimizations::optimizeTreeSecondPass(DB::QueryPlanOptimizationSettings const&, DB::QueryPlan::Node&, std::list<DB::QueryPlan::Node, std::allocator<DB::QueryPlan::Node>>&) @ 0x000000003f31d2d4 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:484: DB::QueryPlan::optimize(DB::QueryPlanOptimizationSettings const&) @ 0x000000003f16d2b5 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:0: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f169fdb in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:31.666043 [ 2360 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:31.667146 [ 2368 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:32.668923 [ 2395 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:32.670300 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:33.673205 [ 2454 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:33.673345 [ 2413 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:34.673803 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:34.674011 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:35.674355 [ 2384 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:35.674793 [ 2361 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:38.086326 [ 3101 ] {b8aa36e4-17e1-4a2f-8a89-6b31f9399623} <Error> executeQuery: Code: 36. DB::Exception: Floating point partition key is not supported: a. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01630_disallow_floating_point_as_partition_key.sql) (in query: /* ddl_entry=query-0000000002 */ CREATE TABLE test_4pgxktz2.test UUID '6532cb06-0063-4bae-b2e0-f712a4fa77a0' (`a` Float32, `b` Int32) ENGINE = MergeTree PARTITION BY a ORDER BY tuple() SETTINGS index_granularity = 33980, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0.05485723540186882, merge_max_block_size = 1320, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 8918631, allow_vertical_merges_from_compact_to_wide_parts = 1, marks_compress_block_size = 85639, primary_key_compress_block_size = 18061), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a759235 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:679: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0aa31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:38.088299 [ 2336 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:38.088800 [ 2333 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:38.866782 [ 3101 ] {b8aa36e4-17e1-4a2f-8a89-6b31f9399623} <Error> executeQuery: Code: 36. DB::Exception: Floating point partition key is not supported: a. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55254) (comment: 01630_disallow_floating_point_as_partition_key.sql) (in query: CREATE TABLE test (`a` Float32, `b` int) ENGINE = MergeTree PARTITION BY a ORDER BY tuple() SETTINGS index_granularity = 33980, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0.05485723540186882, merge_max_block_size = 1320, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 8918631, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 85639, primary_key_compress_block_size = 18061), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a759235 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:679: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0aa31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:38.866848 [ 2950 ] {44b74ab7-4d1d-423d-8e79-60705a34aa16} <Error> executeQuery: Code: 258. DB::Exception: Different number of columns in UNION ALL elements:
c1, c2, c3
and
c1, c2
. (UNION_ALL_RESULT_STRUCTURES_MISMATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55344) (comment: 01036_union_different_columns.sql) (in query: select 1 as c1, 2 as c2, 3 as c3 union all (select 1 as c1, 2 as c2, 3 as c3 union all select 1 as c1, 2 as c2) -- { serverError 258 }
 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:218: DB::InterpreterSelectWithUnionQuery::getCommonHeaderForUnion(std::vector<DB::Block, std::allocator<DB::Block>> const&) @ 0x0000000039d896e4 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d83e75 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:41.739844 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/nrm/rcoqafzwkjfcomcytcyieqssqhtvb, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id b93776d7-7c83-4d9c-bb05-d0bf01e8265d, upload has finished false.
2024.09.24 02:36:41.740031 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/nrm/rcoqafzwkjfcomcytcyieqssqhtvb, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id b93776d7-7c83-4d9c-bb05-d0bf01e8265d, upload has finished false
2024.09.24 02:36:41.783711 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/nrm/rcoqafzwkjfcomcytcyieqssqhtvb, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id b93776d7-7c83-4d9c-bb05-d0bf01e8265d, upload has finished false
2024.09.24 02:36:41.890424 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/mus/hwzclxbmjaddsmjhgulmavkjdyydu, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 708387cc-5eab-46cb-ba90-e27fc1bd8a7f, upload has finished false.
2024.09.24 02:36:41.891306 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/mus/hwzclxbmjaddsmjhgulmavkjdyydu, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 708387cc-5eab-46cb-ba90-e27fc1bd8a7f, upload has finished false
2024.09.24 02:36:41.913784 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/mus/hwzclxbmjaddsmjhgulmavkjdyydu, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 708387cc-5eab-46cb-ba90-e27fc1bd8a7f, upload has finished false
2024.09.24 02:36:44.467755 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 4195237 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:44.467840 [ 3101 ] {b8aa36e4-17e1-4a2f-8a89-6b31f9399623} <Error> TCPHandler: Code: 36. DB::Exception: Floating point partition key is not supported: a. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a759235 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:679: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0aa31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:44.467840 [ 2950 ] {44b74ab7-4d1d-423d-8e79-60705a34aa16} <Error> TCPHandler: Code: 258. DB::Exception: Different number of columns in UNION ALL elements:
c1, c2, c3
and
c1, c2
. (UNION_ALL_RESULT_STRUCTURES_MISMATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:218: DB::InterpreterSelectWithUnionQuery::getCommonHeaderForUnion(std::vector<DB::Block, std::allocator<DB::Block>> const&) @ 0x0000000039d896e4 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d83e75 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:44.467960 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4273469 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:45.040508 [ 3987 ] {1bb57c00-9755-4c77-8194-7fdb1b5e16ce} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1070284 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing FinishAggregatingInOrderTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55230) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT sum(cityHash64(*)) FROM (SELECT CounterID, quantileTiming(0.5)(SendTiming), count() FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) WHERE SendTiming != -1 GROUP BY CounterID);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnAggregateFunction.cpp:287: DB::ColumnAggregateFunction::insertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x000000003ac81c62 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:140: DB::IColumn::cut(unsigned long, unsigned long) const @ 0x00000000352d3b8e in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Merges/Algorithms/FinishAggregatingInOrderAlgorithm.cpp:0: DB::FinishAggregatingInOrderAlgorithm::addToAggregation() @ 0x000000003f06857c in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/FinishAggregatingInOrderAlgorithm.cpp:0: DB::FinishAggregatingInOrderAlgorithm::merge() @ 0x000000003f0671ad in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::FinishAggregatingInOrderAlgorithm>::work() @ 0x000000003f038dc2 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:45.040808 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:45.040809 [ 2368 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:47.021652 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 4276919 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:47.021729 [ 4381 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.67 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:48.656799 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.65 GiB (attempt to allocate chunk of 4205003 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned int, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned int const*, unsigned int const*) @ 0x00000000208b878c in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<unsigned int>>::clone() const @ 0x000000003b422926 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4eadf in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:48.657027 [ 3993 ] {d1fdb2b5-b2d4-41e6-b871-3534dee335fc} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55360) (comment: 02384_analyzer_dict_get_join_get.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:48.657099 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5008548 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:48.657165 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4268733 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:48.657174 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4225213 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:50.985107 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1676797 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column EndURL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_2_2_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 6553): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<4>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370133d2 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:254: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000003701258c in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:612: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForOneColumn() const @ 0x000000003cddd35f in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:842: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::VerticalMergeStage::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8ed8 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000003cde562e in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:52.622984 [ 18138 ] {0b2b85c5-1102-4a3a-bf5d-855c2f338cd7} <Error> ExternalDictionariesLoader: Could not load external dictionary 'bc1e4e9f-8a71-44e3-af6d-4bde83ab7d7f', next update is scheduled at 2024-09-24 02:36:48: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 268435456 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/Allocator.h:199: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9f84 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable<unsigned long, HashMapCell<unsigned long, unsigned long, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, unsigned long>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>::resize(unsigned long, unsigned long) @ 0x000000002aa2b78a in /usr/bin/clickhouse
11. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::blockToAttributes(DB::Block const&) @ 0x000000002c1d35bc in /usr/bin/clickhouse
12. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::loadData() @ 0x000000002c1c40e4 in /usr/bin/clickhouse
13. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::HashedArrayDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::HashedArrayDictionaryStorageConfiguration const&, std::shared_ptr<DB::Block>) @ 0x000000002c1c3902 in /usr/bin/clickhouse
14. DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_2::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, DB::DictionaryKeyType) const @ 0x000000002c1c2642 in /usr/bin/clickhouse
15. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002c1c15d1 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
17. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:52.623042 [ 3976 ] {f459a9fe-18d5-4a3f-a771-022728604b72} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:37892). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37892) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:52.623118 [ 6599 ] {363ea5ca-c654-4727-acbd-f1a885cbfdc6} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:48840). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48840) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:52.623158 [ 2905 ] {ca2f96a5-ac73-4037-8e55-c6ae0602bc44} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:46794). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:46794) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:52.623250 [ 3239 ] {b98802d6-9d60-49a9-87e0-2b319a75007c} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:51414). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51414) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:52.623310 [ 3232 ] {86df0e4e-68c6-437c-80fc-b79c138ce812} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:53318). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:53318) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:52.623368 [ 3982 ] {1b195103-267e-494a-9936-bdb704201727} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:39268). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39268) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:52.623426 [ 3987 ] {1bb57c00-9755-4c77-8194-7fdb1b5e16ce} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1070284 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing FinishAggregatingInOrderTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnAggregateFunction.cpp:287: DB::ColumnAggregateFunction::insertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x000000003ac81c62 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:140: DB::IColumn::cut(unsigned long, unsigned long) const @ 0x00000000352d3b8e in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Merges/Algorithms/FinishAggregatingInOrderAlgorithm.cpp:0: DB::FinishAggregatingInOrderAlgorithm::addToAggregation() @ 0x000000003f06857c in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/FinishAggregatingInOrderAlgorithm.cpp:0: DB::FinishAggregatingInOrderAlgorithm::merge() @ 0x000000003f0671ad in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::FinishAggregatingInOrderAlgorithm>::work() @ 0x000000003f038dc2 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:52.623433 [ 3139 ] {05b283c4-2a5e-4462-8fc2-e0a315078d8f} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:50278). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:50278) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:52.623516 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:52.623570 [ 6603 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:52.623647 [ 2382 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:52.623615 [ 3992 ] {59d3216d-2cd1-4e8e-9e26-09f288136fec} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 41.25 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55352) (comment: 00143_transform_non_const_default.sql) (in query: SELECT transform(SearchEngineID, [2, 3], ['Яндекс', 'Google'], PageCharset) AS title, count() AS c FROM test.hits WHERE SearchEngineID != 0 GROUP BY title HAVING c > 0 ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.992395 [ 3993 ] {d1fdb2b5-b2d4-41e6-b871-3534dee335fc} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.992673 [ 2751 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52248). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.992777 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_70_74_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1233727 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.992730 [ 2118 ] {fa54c948-9f76-47d6-801a-03d9533ef062} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 1.40 MiB (attempt to allocate chunk of 1466400 bytes), maximum: 9.31 GiB: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_8_8_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 32 with max_rows_to_read = 6867): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44634) (comment: 00024_random_counters.sql) (in query: SELECT uniq(UserID), sum(Sign) FROM test.visits WHERE CounterID = 32420158;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
18. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse

2024.09.24 02:36:53.993173 [ 3983 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:34720). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.994656 [ 3982 ] {1b195103-267e-494a-9936-bdb704201727} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:39268). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.995125 [ 3982 ] {1b195103-267e-494a-9936-bdb704201727} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:39268). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.995706 [ 3139 ] {05b283c4-2a5e-4462-8fc2-e0a315078d8f} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:50278). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.996059 [ 3139 ] {05b283c4-2a5e-4462-8fc2-e0a315078d8f} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:50278). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.996469 [ 3232 ] {86df0e4e-68c6-437c-80fc-b79c138ce812} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:53318). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.996542 [ 6599 ] {363ea5ca-c654-4727-acbd-f1a885cbfdc6} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:48840). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.996663 [ 3186 ] {0b2b85c5-1102-4a3a-bf5d-855c2f338cd7} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 268435456 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34286) (comment: 02760_dictionaries_memory.gen.sql) (in query: SYSTEM RELOAD DICTIONARY dict;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/Allocator.h:199: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9f84 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable<unsigned long, HashMapCell<unsigned long, unsigned long, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, unsigned long>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>::resize(unsigned long, unsigned long) @ 0x000000002aa2b78a in /usr/bin/clickhouse
11. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::blockToAttributes(DB::Block const&) @ 0x000000002c1d35bc in /usr/bin/clickhouse
12. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::loadData() @ 0x000000002c1c40e4 in /usr/bin/clickhouse
13. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::HashedArrayDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::HashedArrayDictionaryStorageConfiguration const&, std::shared_ptr<DB::Block>) @ 0x000000002c1c3902 in /usr/bin/clickhouse
14. DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_2::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, DB::DictionaryKeyType) const @ 0x000000002c1c2642 in /usr/bin/clickhouse
15. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002c1c15d1 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
17. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.996722 [ 3992 ] {59d3216d-2cd1-4e8e-9e26-09f288136fec} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 41.25 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.996847 [ 3232 ] {86df0e4e-68c6-437c-80fc-b79c138ce812} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:53318). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.996857 [ 3976 ] {f459a9fe-18d5-4a3f-a771-022728604b72} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:37892). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.997135 [ 3239 ] {b98802d6-9d60-49a9-87e0-2b319a75007c} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:51414). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.997172 [ 2905 ] {ca2f96a5-ac73-4037-8e55-c6ae0602bc44} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:46794). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:53.997304 [ 3976 ] {f459a9fe-18d5-4a3f-a771-022728604b72} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:37892). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.997425 [ 3239 ] {b98802d6-9d60-49a9-87e0-2b319a75007c} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:51414). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.996877 [ 6599 ] {363ea5ca-c654-4727-acbd-f1a885cbfdc6} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:48840). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:53.997506 [ 2905 ] {ca2f96a5-ac73-4037-8e55-c6ae0602bc44} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:46794). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:54.011221 [ 2118 ] {fa54c948-9f76-47d6-801a-03d9533ef062} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 1.40 MiB (attempt to allocate chunk of 1466400 bytes), maximum: 9.31 GiB: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_8_8_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 32 with max_rows_to_read = 6867): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
18. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse

2024.09.24 02:36:54.013189 [ 2377 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:54.013396 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:54.015460 [ 3976 ] {f459a9fe-18d5-4a3f-a771-022728604b72} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:36:54.015460 [ 3239 ] {b98802d6-9d60-49a9-87e0-2b319a75007c} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:36:54.015901 [ 3101 ] {d3b8a8d0-c505-4de7-bf9f-4d811c2fd6e0} <Error> executeQuery: Code: 36. DB::Exception: Floating point partition key is not supported: d. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01630_disallow_floating_point_as_partition_key.sql) (in query: /* ddl_entry=query-0000000005 */ CREATE TABLE test_4pgxktz2.test UUID 'b44b5607-15c3-4fa8-a962-69136df0761c' (`a` Float32, `b` Int32, `c` String, `d` Float64) ENGINE = MergeTree PARTITION BY (b, c, d) ORDER BY tuple() SETTINGS allow_floating_point_partition_key = 0, index_granularity = 33980, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0.05485723540186882, merge_max_block_size = 1320, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 8918631, allow_vertical_merges_from_compact_to_wide_parts = 1, marks_compress_block_size = 85639, primary_key_compress_block_size = 18061), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a759235 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:679: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0aa31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:54.019001 [ 3232 ] {86df0e4e-68c6-437c-80fc-b79c138ce812} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:36:54.022659 [ 6599 ] {363ea5ca-c654-4727-acbd-f1a885cbfdc6} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:36:54.027630 [ 3186 ] {0b2b85c5-1102-4a3a-bf5d-855c2f338cd7} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 268435456 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/Allocator.h:199: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9f84 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable<unsigned long, HashMapCell<unsigned long, unsigned long, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, unsigned long>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>::resize(unsigned long, unsigned long) @ 0x000000002aa2b78a in /usr/bin/clickhouse
11. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::blockToAttributes(DB::Block const&) @ 0x000000002c1d35bc in /usr/bin/clickhouse
12. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::loadData() @ 0x000000002c1c40e4 in /usr/bin/clickhouse
13. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::HashedArrayDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::HashedArrayDictionaryStorageConfiguration const&, std::shared_ptr<DB::Block>) @ 0x000000002c1c3902 in /usr/bin/clickhouse
14. DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_2::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, DB::DictionaryKeyType) const @ 0x000000002c1c2642 in /usr/bin/clickhouse
15. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002c1c15d1 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
17. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:54.039087 [ 3982 ] {1b195103-267e-494a-9936-bdb704201727} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:36:54.044967 [ 3139 ] {05b283c4-2a5e-4462-8fc2-e0a315078d8f} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:36:54.045062 [ 2905 ] {ca2f96a5-ac73-4037-8e55-c6ae0602bc44} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:36:54.049442 [ 3101 ] {d3b8a8d0-c505-4de7-bf9f-4d811c2fd6e0} <Error> executeQuery: Code: 36. DB::Exception: Floating point partition key is not supported: d. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55254) (comment: 01630_disallow_floating_point_as_partition_key.sql) (in query: CREATE TABLE test (`a` Float32, `b` int, `c` String, `d` Float64) ENGINE = MergeTree PARTITION BY (b, c, d) ORDER BY tuple() SETTINGS allow_floating_point_partition_key = 0, index_granularity = 33980, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0.05485723540186882, merge_max_block_size = 1320, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 8918631, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 85639, primary_key_compress_block_size = 18061), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a759235 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:679: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0aa31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:54.052391 [ 3101 ] {d3b8a8d0-c505-4de7-bf9f-4d811c2fd6e0} <Error> TCPHandler: Code: 36. DB::Exception: Floating point partition key is not supported: d. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a759235 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:679: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da0aa31 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a98cb8 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr<zkutil::ZooKeeper> const&) @ 0x0000000037a92d0e in /usr/bin/clickhouse
13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr<DB::Context const>) @ 0x00000000371d4981 in /usr/bin/clickhouse
14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, bool) @ 0x0000000037151b7d in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dcc83 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:55.014228 [ 2413 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:55.017076 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:56.025194 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:56.025489 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:58.430374 [ 2439 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:58.430372 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:58.439848 [ 2782 ] {9fb44b10-992b-47f1-991f-a2e6eaaaef9e} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Int8 of 2nd (optional) argument of function toDayOfWeek. Must be constant UInt8 (week mode).: While processing toDayOfWeek(today(), -1). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:54850) (comment: 02521_to_custom_day_of_week.sql) (in query: select toDayOfWeek(today(), -1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::IFunctionCustomWeek<DB::ToDayOfWeekImpl>::checkArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, bool) const @ 0x000000001d1b1adf in /usr/bin/clickhouse
4. DB::FunctionCustomWeekToSomething<DB::DataTypeNumber<char8_t>, DB::ToDayOfWeekImpl>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001d1abcf8 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:36:59.255949 [ 2782 ] {9fb44b10-992b-47f1-991f-a2e6eaaaef9e} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Int8 of 2nd (optional) argument of function toDayOfWeek. Must be constant UInt8 (week mode).: While processing toDayOfWeek(today(), -1). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::IFunctionCustomWeek<DB::ToDayOfWeekImpl>::checkArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, bool) const @ 0x000000001d1b1adf in /usr/bin/clickhouse
4. DB::FunctionCustomWeekToSomething<DB::DataTypeNumber<char8_t>, DB::ToDayOfWeekImpl>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001d1abcf8 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:36:59.275086 [ 3101 ] {2ff23199-9b5f-4c6f-895d-f8a02d6d758a} <Error> executeQuery: Code: 78. DB::Exception: Query has infile and was send directly to server. (UNKNOWN_TYPE_OF_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:53122) (comment: 02009_from_infile.sh) (in query: INSERT INTO test_infile_url FROM INFILE '/tmp/clickhouse-test/0_stateless/test_infile.gz' FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [49]>(int, char const (&) [49]) @ 0x000000000c82e537 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/Transforms/getSourceFromASTInsertQuery.cpp:0: DB::getInputFormatFromASTInsertQuery(std::shared_ptr<DB::IAST> const&, bool, DB::Block const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&) @ 0x000000003ede32cb in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:624: DB::InterpreterInsertQuery::execute() @ 0x0000000039abaea5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
8. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:36:59.345854 [ 3101 ] {2ff23199-9b5f-4c6f-895d-f8a02d6d758a} <Error> DynamicQueryHandler: Code: 78. DB::Exception: Query has infile and was send directly to server. (UNKNOWN_TYPE_OF_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [49]>(int, char const (&) [49]) @ 0x000000000c82e537 in /usr/bin/clickhouse
3. ./build_docker/./src/Processors/Transforms/getSourceFromASTInsertQuery.cpp:0: DB::getInputFormatFromASTInsertQuery(std::shared_ptr<DB::IAST> const&, bool, DB::Block const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&) @ 0x000000003ede32cb in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:624: DB::InterpreterInsertQuery::execute() @ 0x0000000039abaea5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
8. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:59.443273 [ 2424 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:36:59.540971 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:02.209301 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5043229 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:02.209559 [ 3993 ] {2805fb01-bc9b-4eef-93a6-97da833f6253} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 335.26 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:54778) (comment: 00037_uniq_state_merge1.sql) (in query: SELECT k, any(u) AS u, uniqMerge(us) AS us FROM (SELECT domain(URL) AS k, uniq(UserID) AS u, uniqState(UserID) AS us FROM test.hits GROUP BY k) GROUP BY k ORDER BY u DESC, k ASC LIMIT 100 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:02.715598 [ 2345 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:02.715641 [ 2759 ] {4ef20b58-c05a-41d5-a247-49e8b0895362} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46982) (comment: 00145_aggregate_functions_statistics.sql) (in query: SELECT stddevPop(ResolutionWidth) FROM (SELECT ResolutionWidth FROM test.hits LIMIT 1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:03.788090 [ 2461 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:03.788150 [ 3993 ] {2805fb01-bc9b-4eef-93a6-97da833f6253} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 335.26 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:03.788153 [ 2759 ] {4ef20b58-c05a-41d5-a247-49e8b0895362} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:03.788196 [ 18167 ] {} <Error> ExternalDictionariesLoader: Could not load external dictionary 'bc1e4e9f-8a71-44e3-af6d-4bde83ab7d7f', next update is scheduled at 2024-09-24 02:37:05: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 16777216 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
8. auto DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::blockToAttributes(DB::Block const&)::'lambda'(auto const&)::operator()<DB::DictionaryAttributeType<(DB::AttributeUnderlyingType)4>>(auto const&) const @ 0x000000002c1ffd09 in /usr/bin/clickhouse
9. void detail::static_for<DB::AttributeUnderlyingType, void DB::callOnDictionaryAttributeType<DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::blockToAttributes(DB::Block const&)::'lambda'(auto const&)&>(DB::AttributeUnderlyingType, auto&&)::'lambda'(auto), 0ul, 1ul, 2ul, 3ul, 4ul, 5ul, 6ul, 7ul, 8ul, 9ul, 10ul, 11ul, 12ul, 13ul, 14ul, 15ul, 16ul, 17ul, 18ul, 19ul, 20ul, 21ul, 22ul, 23ul>(void DB::callOnDictionaryAttributeType<DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::blockToAttributes(DB::Block const&)::'lambda'(auto const&)&>(DB::AttributeUnderlyingType, auto&&)::'lambda'(auto)&&, std::integer_sequence<unsigned long, 0ul, 1ul, 2ul, 3ul, 4ul, 5ul, 6ul, 7ul, 8ul, 9ul, 10ul, 11ul, 12ul, 13ul, 14ul, 15ul, 16ul, 17ul, 18ul, 19ul, 20ul, 21ul, 22ul, 23ul>) @ 0x000000002c1fde5c in /usr/bin/clickhouse
10. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::blockToAttributes(DB::Block const&) @ 0x000000002c1d330b in /usr/bin/clickhouse
11. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::loadData() @ 0x000000002c1c40e4 in /usr/bin/clickhouse
12. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::HashedArrayDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::HashedArrayDictionaryStorageConfiguration const&, std::shared_ptr<DB::Block>) @ 0x000000002c1c3902 in /usr/bin/clickhouse
13. DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_2::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, DB::DictionaryKeyType) const @ 0x000000002c1c2642 in /usr/bin/clickhouse
14. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002c1c15d1 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:03.788179 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {f9daad03-8197-4a22-97ea-3583d7fdce05::202409_1_21_4}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x000000002089312c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000002088e69d in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x00000000207ac6df in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ThreadFuzzer.cpp:242: DB::ThreadFuzzer::maybeInjectMemoryLimitException() @ 0x00000000209420d6 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003dacefcf in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc15 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:03.788232 [ 6598 ] {ab08aa91-1b99-4fe7-8fd8-e2fb9108b17b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:54806) (comment: 00030_array_enumerate_uniq.sql) (in query: SELECT max(arrayJoin(arrayEnumerateUniq(arrayMap(x -> intDiv(x, 10), URLCategories)))) FROM test.hits ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:03.788353 [ 2362 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:04.616326 [ 6598 ] {ab08aa91-1b99-4fe7-8fd8-e2fb9108b17b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:04.792951 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:04.796039 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:05.795951 [ 2354 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:05.796698 [ 2412 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:06.796524 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:06.806746 [ 2369 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:07.805128 [ 2456 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:07.809922 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:08.815192 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:08.815191 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:09.826109 [ 2467 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:09.826206 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:10.827501 [ 2362 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:10.827856 [ 2357 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:12.778726 [ 2905 ] {6d26e618-7384-4c1b-8404-125774df1dc2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1278048 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42036) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:17.298227 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:17.298321 [ 2331 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:17.301861 [ 3982 ] {c7f24275-b5b8-4fb2-bf0a-0b303e5fc542} <Error> executeQuery: Code: 306. DB::Exception: Maximum parse depth (1000) exceeded. Consider rising max_parser_depth parameter. (TOO_DEEP_RECURSION) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:57524) (comment: 00984_parser_stack_overflow.sh) (in query: ((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((((), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned int&>::type>, unsigned int&) @ 0x0000000035402fb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Parsers/IParser.h:74: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fdeda44 in /usr/bin/clickhouse
4. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse
5. ./build_docker/./src/Parsers/ExpressionListParsers.h:91: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd833b9 in /usr/bin/clickhouse
6. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
7. ./build_docker/./src/Parsers/ParserSelectWithUnionQuery.cpp:0: DB::ParserSelectWithUnionQuery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fea23da in /usr/bin/clickhouse
8. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
9. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:115: DB::ParserSubquery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd20956 in /usr/bin/clickhouse
10. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
11. ./build_docker/./src/Parsers/ParserUnionQueryElement.cpp:13: DB::ParserUnionQueryElement::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee5d9b in /usr/bin/clickhouse
12. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
13. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse
14. ./build_docker/./src/Parsers/ExpressionListParsers.h:91: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd833b9 in /usr/bin/clickhouse
15. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
16. ./build_docker/./src/Parsers/ParserSelectWithUnionQuery.cpp:0: DB::ParserSelectWithUnionQuery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fea23da in /usr/bin/clickhouse
17. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
18. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:115: DB::ParserSubquery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd20956 in /usr/bin/clickhouse
19. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
20. ./build_docker/./src/Parsers/ParserUnionQueryElement.cpp:13: DB::ParserUnionQueryElement::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee5d9b in /usr/bin/clickhouse
21. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
22. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse
23. ./build_docker/./src/Parsers/ExpressionListParsers.h:91: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd833b9 in /usr/bin/clickhouse
24. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
25. ./build_docker/./src/Parsers/ParserSelectWithUnionQuery.cpp:0: DB::ParserSelectWithUnionQuery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fea23da in /usr/bin/clickhouse
26. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
27. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:115: DB::ParserSubquery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd20956 in /usr/bin/clickhouse
28. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
29. ./build_docker/./src/Parsers/ParserUnionQueryElement.cpp:13: DB::ParserUnionQueryElement::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee5d9b in /usr/bin/clickhouse
30. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
31. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse

2024.09.24 02:37:19.091653 [ 2905 ] {6d26e618-7384-4c1b-8404-125774df1dc2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1278048 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:19.091757 [ 2118 ] {9bf974b2-f92f-4a03-a31f-ec90364dcccf} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50746) (comment: 00081_group_by_without_key_and_totals.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:19.091828 [ 3982 ] {c7f24275-b5b8-4fb2-bf0a-0b303e5fc542} <Error> DynamicQueryHandler: Code: 306. DB::Exception: Maximum parse depth (1000) exceeded. Consider rising max_parser_depth parameter. (TOO_DEEP_RECURSION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned int&>::type>, unsigned int&) @ 0x0000000035402fb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Parsers/IParser.h:74: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fdeda44 in /usr/bin/clickhouse
4. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse
5. ./build_docker/./src/Parsers/ExpressionListParsers.h:91: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd833b9 in /usr/bin/clickhouse
6. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
7. ./build_docker/./src/Parsers/ParserSelectWithUnionQuery.cpp:0: DB::ParserSelectWithUnionQuery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fea23da in /usr/bin/clickhouse
8. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
9. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:115: DB::ParserSubquery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd20956 in /usr/bin/clickhouse
10. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
11. ./build_docker/./src/Parsers/ParserUnionQueryElement.cpp:13: DB::ParserUnionQueryElement::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee5d9b in /usr/bin/clickhouse
12. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
13. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse
14. ./build_docker/./src/Parsers/ExpressionListParsers.h:91: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd833b9 in /usr/bin/clickhouse
15. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
16. ./build_docker/./src/Parsers/ParserSelectWithUnionQuery.cpp:0: DB::ParserSelectWithUnionQuery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fea23da in /usr/bin/clickhouse
17. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
18. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:115: DB::ParserSubquery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd20956 in /usr/bin/clickhouse
19. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
20. ./build_docker/./src/Parsers/ParserUnionQueryElement.cpp:13: DB::ParserUnionQueryElement::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee5d9b in /usr/bin/clickhouse
21. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
22. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse
23. ./build_docker/./src/Parsers/ExpressionListParsers.h:91: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd833b9 in /usr/bin/clickhouse
24. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
25. ./build_docker/./src/Parsers/ParserSelectWithUnionQuery.cpp:0: DB::ParserSelectWithUnionQuery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fea23da in /usr/bin/clickhouse
26. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
27. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:115: DB::ParserSubquery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd20956 in /usr/bin/clickhouse
28. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
29. ./build_docker/./src/Parsers/ParserUnionQueryElement.cpp:13: DB::ParserUnionQueryElement::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee5d9b in /usr/bin/clickhouse
30. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
31. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:19.091949 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_1_71_9}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:167: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000003700474d in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:19.093184 [ 2751 ] {c464ba01-a715-4299-9307-ef9e500a54c2} <Error> executeQuery: Code: 675. DB::Exception: Invalid IPv4 value: While processing IPv4StringToNum('test'). (CANNOT_PARSE_IPV4) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42124) (comment: 02234_cast_to_ip_address.sql) (in query: SELECT IPv4StringToNum('test');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [19]>(int, char const (&) [19]) @ 0x0000000009447077 in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::convertToIPv4<(DB::IPStringToNumExceptionMode)0, DB::ColumnVector<unsigned int>>(COW<DB::IColumn>::immutable_ptr<DB::IColumn>, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000000a9cd2af in /usr/bin/clickhouse
4. DB::FunctionIPv4StringToNum<(DB::IPStringToNumExceptionMode)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a9c8c65 in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:37:19.093517 [ 2341 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:19.093228 [ 2348 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:20.654374 [ 2751 ] {c464ba01-a715-4299-9307-ef9e500a54c2} <Error> TCPHandler: Code: 675. DB::Exception: Invalid IPv4 value: While processing IPv4StringToNum('test'). (CANNOT_PARSE_IPV4), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [19]>(int, char const (&) [19]) @ 0x0000000009447077 in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::convertToIPv4<(DB::IPStringToNumExceptionMode)0, DB::ColumnVector<unsigned int>>(COW<DB::IColumn>::immutable_ptr<DB::IColumn>, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000000a9cd2af in /usr/bin/clickhouse
4. DB::FunctionIPv4StringToNum<(DB::IPStringToNumExceptionMode)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a9c8c65 in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:37:20.654408 [ 2118 ] {9bf974b2-f92f-4a03-a31f-ec90364dcccf} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:20.654603 [ 3991 ] {0258efbf-59c2-49da-945f-9ffdb27ae309} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 20.09 MiB (attempt to allocate chunk of 2228352 bytes), maximum: 19.07 MiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50702) (comment: 01655_plan_optimizations_optimize_read_in_window_order_long.sh) (in query: select n, sum(x) OVER (PARTITION BY n+x%2 ORDER BY n, x ROWS BETWEEN 100 PRECEDING AND CURRENT ROW) from test_01655_plan_optimizations_optimize_read_in_window_order_long_n_x SETTINGS optimize_read_in_order=1, max_memory_usage=20000000, max_threads=1 format Null), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<long>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b260c7e in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<long>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<long>::less>(auto, auto, auto) const @ 0x000000003b68188c in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<long>::less, DB::ColumnVector<long>::equals, DB::ColumnVector<long>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<long>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b35a9f7 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<long>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b35a31e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:23.022803 [ 2388 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:23.023432 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:23.038241 [ 3982 ] {cf2185ea-69cf-406b-ab97-9b1bf8b145ab} <Error> executeQuery: Code: 306. DB::Exception: Maximum parse depth (1000) exceeded. Consider rising max_parser_depth parameter. (TOO_DEEP_RECURSION) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:54664) (comment: 00984_parser_stack_overflow.sh) (in query: SELECT [[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned int&>::type>, unsigned int&) @ 0x0000000035402fb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Parsers/IParser.h:74: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fdeda44 in /usr/bin/clickhouse
4. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:833: DB::ParserNull::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd3d5d1 in /usr/bin/clickhouse
5. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
6. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:0: DB::ParserLiteral::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd4968e in /usr/bin/clickhouse
7. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
8. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:1215: DB::ParserCollectionOfLiterals<DB::Array>::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd7350c in /usr/bin/clickhouse
9. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
10. ./build_docker/./src/Parsers/ExpressionElementParsers.h:313: DB::ParserArrayOfLiterals::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003eae038d in /usr/bin/clickhouse
11. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
12. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:2566: DB::ParserExpressionImpl::tryParseOperand(std::vector<std::unique_ptr<DB::Layer, std::default_delete<DB::Layer>>, std::allocator<std::unique_ptr<DB::Layer, std::default_delete<DB::Layer>>>>&, DB::IParser::Pos&, DB::Expected&) @ 0x000000003fd95a3d in /usr/bin/clickhouse
13. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:0: DB::ParserExpressionImpl::parse(std::unique_ptr<DB::Layer, std::default_delete<DB::Layer>>, DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd9138d in /usr/bin/clickhouse
14. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:2299: DB::ParserExpression::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd90dd6 in /usr/bin/clickhouse
15. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
16. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:2012: DB::ParserWithOptionalAlias::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd64995 in /usr/bin/clickhouse
17. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
18. ./build_docker/./src/Parsers/ExpressionListParsers.h:208: DB::ParserExpressionWithOptionalAlias::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x0000000020f5d7ee in /usr/bin/clickhouse
19. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
20. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:50: DB::ParserList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda388c in /usr/bin/clickhouse
21. ./build_docker/./src/Parsers/ExpressionListParsers.h:0: DB::ParserList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd8270e in /usr/bin/clickhouse
22. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
23. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:0: DB::ParserExpressionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd88e4d in /usr/bin/clickhouse
24. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
25. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:325: DB::ParserNotEmptyExpressionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd89112 in /usr/bin/clickhouse
26. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
27. ./build_docker/./src/Parsers/ParserSelectQuery.cpp:171: DB::ParserSelectQuery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee94d9 in /usr/bin/clickhouse
28. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
29. ./build_docker/./src/Parsers/ParserUnionQueryElement.cpp:13: DB::ParserUnionQueryElement::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee5e10 in /usr/bin/clickhouse
30. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
31. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse

2024.09.24 02:37:24.765635 [ 18158 ] {} <Error> ExternalDictionariesLoader: Could not load external dictionary 'bc1e4e9f-8a71-44e3-af6d-4bde83ab7d7f', next update is scheduled at 2024-09-24 02:37:25: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 268435456 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/Allocator.h:199: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9f84 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable<unsigned long, HashMapCell<unsigned long, unsigned long, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, unsigned long>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>::resize(unsigned long, unsigned long) @ 0x000000002aa2b78a in /usr/bin/clickhouse
9. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::blockToAttributes(DB::Block const&) @ 0x000000002c1d35bc in /usr/bin/clickhouse
10. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::loadData() @ 0x000000002c1c40e4 in /usr/bin/clickhouse
11. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::HashedArrayDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::HashedArrayDictionaryStorageConfiguration const&, std::shared_ptr<DB::Block>) @ 0x000000002c1c3902 in /usr/bin/clickhouse
12. DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_2::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, DB::DictionaryKeyType) const @ 0x000000002c1c2642 in /usr/bin/clickhouse
13. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002c1c15d1 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:24.765683 [ 3991 ] {0258efbf-59c2-49da-945f-9ffdb27ae309} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 20.09 MiB (attempt to allocate chunk of 2228352 bytes), maximum: 19.07 MiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<long>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b260c7e in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<long>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<long>::less>(auto, auto, auto) const @ 0x000000003b68188c in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<long>::less, DB::ColumnVector<long>::equals, DB::ColumnVector<long>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<long>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b35a9f7 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<long>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b35a31e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:26.482922 [ 3982 ] {cf2185ea-69cf-406b-ab97-9b1bf8b145ab} <Error> DynamicQueryHandler: Code: 306. DB::Exception: Maximum parse depth (1000) exceeded. Consider rising max_parser_depth parameter. (TOO_DEEP_RECURSION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned int&>::type>, unsigned int&) @ 0x0000000035402fb7 in /usr/bin/clickhouse
3. ./build_docker/./src/Parsers/IParser.h:74: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fdeda44 in /usr/bin/clickhouse
4. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:833: DB::ParserNull::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd3d5d1 in /usr/bin/clickhouse
5. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
6. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:0: DB::ParserLiteral::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd4968e in /usr/bin/clickhouse
7. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
8. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:1215: DB::ParserCollectionOfLiterals<DB::Array>::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd7350c in /usr/bin/clickhouse
9. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
10. ./build_docker/./src/Parsers/ExpressionElementParsers.h:313: DB::ParserArrayOfLiterals::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003eae038d in /usr/bin/clickhouse
11. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
12. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:2566: DB::ParserExpressionImpl::tryParseOperand(std::vector<std::unique_ptr<DB::Layer, std::default_delete<DB::Layer>>, std::allocator<std::unique_ptr<DB::Layer, std::default_delete<DB::Layer>>>>&, DB::IParser::Pos&, DB::Expected&) @ 0x000000003fd95a3d in /usr/bin/clickhouse
13. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:0: DB::ParserExpressionImpl::parse(std::unique_ptr<DB::Layer, std::default_delete<DB::Layer>>, DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd9138d in /usr/bin/clickhouse
14. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:2299: DB::ParserExpression::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd90dd6 in /usr/bin/clickhouse
15. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
16. ./build_docker/./src/Parsers/ExpressionElementParsers.cpp:2012: DB::ParserWithOptionalAlias::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd64995 in /usr/bin/clickhouse
17. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
18. ./build_docker/./src/Parsers/ExpressionListParsers.h:208: DB::ParserExpressionWithOptionalAlias::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x0000000020f5d7ee in /usr/bin/clickhouse
19. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
20. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:50: DB::ParserList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda388c in /usr/bin/clickhouse
21. ./build_docker/./src/Parsers/ExpressionListParsers.h:0: DB::ParserList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd8270e in /usr/bin/clickhouse
22. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
23. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:0: DB::ParserExpressionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd88e4d in /usr/bin/clickhouse
24. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
25. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:325: DB::ParserNotEmptyExpressionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fd89112 in /usr/bin/clickhouse
26. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
27. ./build_docker/./src/Parsers/ParserSelectQuery.cpp:171: DB::ParserSelectQuery::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee94d9 in /usr/bin/clickhouse
28. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
29. ./build_docker/./src/Parsers/ParserUnionQueryElement.cpp:13: DB::ParserUnionQueryElement::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fee5e10 in /usr/bin/clickhouse
30. ./build_docker/./src/Parsers/IParserBase.cpp:13: DB::IParserBase::parse(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&) @ 0x000000003fded595 in /usr/bin/clickhouse
31. ./build_docker/./src/Parsers/ExpressionListParsers.cpp:79: DB::ParserUnionList::parseImpl(DB::IParser::Pos&, std::shared_ptr<DB::IAST>&, DB::Expected&)::$_0::operator()() const @ 0x000000003fda3c6c in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:27.917121 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4209146 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:269: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66b425 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:27.917234 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4216794 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:269: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66b425 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:27.938852 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4221885 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:29.607970 [ 2537 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:30.495509 [ 3992 ] {8f818e62-88db-43e8-bbe7-6939b9524e19} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50834) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:31.428321 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:31.428406 [ 3983 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:31.431359 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:31.434964 [ 2759 ] {87834d0e-1534-4447-8dee-632f4ae20c73} <Error> DynamicQueryHandler: Code: 271. DB::Exception: Cannot decompress Gorilla-encoded data. File has wrong header. (CANNOT_DECOMPRESS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [62]>(int, char const (&) [62]) @ 0x000000000ae646d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Compression/CompressionCodecGorilla.cpp:429: DB::CompressionCodecGorilla::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x00000000369af31d in /usr/bin/clickhouse
4. ./build_docker/./src/Compression/ICompressionCodec.cpp:112: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x00000000369cfaaa in /usr/bin/clickhouse
5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:308: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x00000000368ab1a3 in /usr/bin/clickhouse
6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x00000000368a5253 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper<std::nullptr_t>::nextImpl() @ 0x0000000036204997 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x00000000377fda03 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadBuffer.h:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9ac740 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:32.748053 [ 2751 ] {7f73871a-8f90-41ef-90b9-5cc4434d720f} <Error> executeQuery: Code: 675. DB::ParsingException: Cannot parse IPv4 test: Cannot parse IPv4 from String: While processing toIPv4('test'). (CANNOT_PARSE_IPV4) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42124) (comment: 02234_cast_to_ip_address.sql) (in query: SELECT toIPv4('test');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::ParsingException::ParsingException<std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000009e613bb in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ConvertThroughParsing<DB::DataTypeString, DB::DataTypeIPv4, DB::NameToIPv4, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, void*) @ 0x0000000009eb7809 in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<DB::DataTypeIPv4, DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009e718d5 in /usr/bin/clickhouse
5. DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009e64a93 in /usr/bin/clickhouse
6. DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009e632c2 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:37:32.748124 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_74_14}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:34.461782 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4209918 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:37.866501 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4284567 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:40.031799 [ 2782 ] {287c58ca-3453-40b8-8f25-b30a3c47a78c} <Error> executeQuery: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_4.txt' with part 'all_1_1_1_3' reason: 'Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:54938) (comment: 02352_lightweight_delete.sql) (in query: ALTER TABLE lwd_test UPDATE value = 'v' WHERE id % 2 == 0 SETTINGS mutations_sync = 2;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, String, String&, String&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, char const*&&, String&&, String&, String&) @ 0x000000003d40c6c4 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional<DB::MergeTreeMutationStatus>&, std::set<String, std::less<String>, std::allocator<String>> const&) @ 0x000000003d40bf75 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003da2c68d in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000003da2eb73 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f9be2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:40.035029 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 2062462 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:35: DB::MergedColumnOnlyOutputStream::MergedColumnOnlyOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::Block const&, std::shared_ptr<DB::ICompressionCodec>, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::set<String, std::less<String>, std::allocator<String>>*, DB::MergeTreeIndexGranularity const&, DB::MergeTreeIndexGranularityInfo const*) @ 0x000000003d678aec in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTask::VerticalMergeStage::prepareVerticalMergeForOneColumn() const @ 0x000000003cddbc40 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::VerticalMergeStage::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8eb8 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000003cde562e in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:40.801228 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4198589 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:40.801592 [ 2395 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:40.801229 [ 3992 ] {8f818e62-88db-43e8-bbe7-6939b9524e19} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:40.802326 [ 2751 ] {7f73871a-8f90-41ef-90b9-5cc4434d720f} <Error> TCPHandler: Code: 675. DB::ParsingException: Cannot parse IPv4 test: Cannot parse IPv4 from String: While processing toIPv4('test'). (CANNOT_PARSE_IPV4), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::ParsingException::ParsingException<std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000009e613bb in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ConvertThroughParsing<DB::DataTypeString, DB::DataTypeIPv4, DB::NameToIPv4, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, void*) @ 0x0000000009eb7809 in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<DB::DataTypeIPv4, DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009e718d5 in /usr/bin/clickhouse
5. DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009e64a93 in /usr/bin/clickhouse
6. DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009e632c2 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:37:40.805422 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:40.807350 [ 15685 ] {} <Error> ExternalDictionariesLoader: Could not load external dictionary 'bc1e4e9f-8a71-44e3-af6d-4bde83ab7d7f', next update is scheduled at 2024-09-24 02:37:41: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4206728 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9bb7 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable<unsigned long, HashMapCell<unsigned long, unsigned long, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, unsigned long>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>::resize(unsigned long, unsigned long) @ 0x000000002aa2b78a in /usr/bin/clickhouse
8. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::loadData() @ 0x000000002c1c40d9 in /usr/bin/clickhouse
9. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::HashedArrayDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::HashedArrayDictionaryStorageConfiguration const&, std::shared_ptr<DB::Block>) @ 0x000000002c1c3902 in /usr/bin/clickhouse
10. DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_2::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, DB::DictionaryKeyType) const @ 0x000000002c1c2642 in /usr/bin/clickhouse
11. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002c1c15d1 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
13. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:43.568444 [ 2782 ] {287c58ca-3453-40b8-8f25-b30a3c47a78c} <Error> TCPHandler: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_4.txt' with part 'all_1_1_1_3' reason: 'Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, String, String&, String&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, char const*&&, String&&, String&, String&) @ 0x000000003d40c6c4 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional<DB::MergeTreeMutationStatus>&, std::set<String, std::less<String>, std::allocator<String>> const&) @ 0x000000003d40bf75 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003da2c68d in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000003da2eb73 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f9be2 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:43.568511 [ 2537 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:43.568582 [ 2554 ] {} <Error> test_ezi7inof.tableOut (4e3798b7-ae6d-4786-9b94-0a30f7acc669): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 86. DB::HTTPException: Received error from remote server /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02916%2Ftest_ezi7inof%2Ftable%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false&remote_fs_metadata=s3. HTTP status code: 500 Internal Server Error, body: Code: 236. DB::Exception: Could not exchange part all_0_0_0 as it's in preActive state (1000 ms) and it uses zero copy replication. This is expected behaviour and the client will retry fetching the part automatically. (ABORTED) (version 23.8.16.41.altinitystable (altinity build)). (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b15cf81 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b1651ce in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::initialize() @ 0x000000002b162802 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::ReadWriteBufferFromHTTPBase(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function<void (std::basic_ostream<char, std::char_traits<char>>&)>, unsigned long, DB::ReadSettings const&, std::vector<DB::HTTPHeaderEntry, std::allocator<DB::HTTPHeaderEntry>>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional<DB::HTTPFileInfo>, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x000000002b161b97 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function<void (std::basic_ostream<char, std::char_traits<char>>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x000000002b13fd7e in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::PooledReadWriteBufferFromHTTP>::__unique_single std::make_unique[abi:v15000]<DB::PooledReadWriteBufferFromHTTP, Poco::URI&, String const&, std::nullptr_t, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long, int, unsigned long>(Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x000000003cb9f95d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr<DB::Throttler>, bool, String const&, std::optional<DB::CurrentlySubmergingEmergingTagger>*, bool, std::shared_ptr<DB::IDisk>) @ 0x000000003cb77c3d in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::shared_ptr<DB::IMergeTreeDataPart> std::__function::__policy_invoker<std::shared_ptr<DB::IMergeTreeDataPart> ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_4, std::shared_ptr<DB::IMergeTreeDataPart> ()>>(std::__function::__policy_storage const*) @ 0x000000003c290209 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4620: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool) @ 0x000000003c057eff in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003c02bfb0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x000000003bff0e8a in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr<DB::ReplicatedMergeTreeQueue::SelectedEntry>)::$_1, bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>>(std::__function::__policy_storage const*, std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&) @ 0x000000003c289810 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ReplicatedMergeTreeQueue::processEntry(std::function<std::shared_ptr<zkutil::ZooKeeper> ()>, std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&, std::function<bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>) @ 0x000000003d8c57ac in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr<DB::ReplicatedMergeTreeQueue::SelectedEntry>) @ 0x000000003c0bc836 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003c28c0df in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:43.568590 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_76_17}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1076047 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:43.568762 [ 2326 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:43.568760 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:43.568619 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_72_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1165672 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<unsigned long>::insert(DB::Field const&) @ 0x000000003b2cac89 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x000000003b24c1a0 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnArray.cpp:0: DB::ColumnArray::insert(DB::Field const&) @ 0x000000003ac9cd2d in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnMap.cpp:0: DB::ColumnMap::insert(DB::Field const&) @ 0x000000003b13b49a in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b8d0a23 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:43.569089 [ 2550 ] {} <Error> test_ezi7inof.tableOut (4e3798b7-ae6d-4786-9b94-0a30f7acc669): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 86. DB::HTTPException: Received error from remote server /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02916%2Ftest_ezi7inof%2Ftable%2Freplicas%2F1&part=all_1_1_0&client_protocol_version=8&compress=false&remote_fs_metadata=s3. HTTP status code: 500 Internal Server Error, body: Code: 236. DB::Exception: Could not exchange part all_1_1_0 as it's in preActive state (1000 ms) and it uses zero copy replication. This is expected behaviour and the client will retry fetching the part automatically. (ABORTED) (version 23.8.16.41.altinitystable (altinity build)). (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b15cf81 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b1651ce in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::initialize() @ 0x000000002b162802 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::ReadWriteBufferFromHTTPBase(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function<void (std::basic_ostream<char, std::char_traits<char>>&)>, unsigned long, DB::ReadSettings const&, std::vector<DB::HTTPHeaderEntry, std::allocator<DB::HTTPHeaderEntry>>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional<DB::HTTPFileInfo>, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x000000002b161b97 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function<void (std::basic_ostream<char, std::char_traits<char>>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x000000002b13fd7e in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::PooledReadWriteBufferFromHTTP>::__unique_single std::make_unique[abi:v15000]<DB::PooledReadWriteBufferFromHTTP, Poco::URI&, String const&, std::nullptr_t, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long, int, unsigned long>(Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x000000003cb9f95d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr<DB::Throttler>, bool, String const&, std::optional<DB::CurrentlySubmergingEmergingTagger>*, bool, std::shared_ptr<DB::IDisk>) @ 0x000000003cb77c3d in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::shared_ptr<DB::IMergeTreeDataPart> std::__function::__policy_invoker<std::shared_ptr<DB::IMergeTreeDataPart> ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_4, std::shared_ptr<DB::IMergeTreeDataPart> ()>>(std::__function::__policy_storage const*) @ 0x000000003c290209 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4620: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool) @ 0x000000003c057eff in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003c02bfb0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x000000003bff0e8a in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr<DB::ReplicatedMergeTreeQueue::SelectedEntry>)::$_1, bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>>(std::__function::__policy_storage const*, std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&) @ 0x000000003c289810 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ReplicatedMergeTreeQueue::processEntry(std::function<std::shared_ptr<zkutil::ZooKeeper> ()>, std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&, std::function<bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>) @ 0x000000003d8c57ac in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr<DB::ReplicatedMergeTreeQueue::SelectedEntry>) @ 0x000000003c0bc836 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003c28c0df in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:44.820212 [ 2537 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:47.904532 [ 3994 ] {test_15_hash_table_sizes_stats_2161109} <Error> PullingAsyncPipelineExecutor: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:49.352845 [ 3239 ] {ee7c4788-f946-4afd-9f54-b8171fb963bd} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1830912 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (avg_value_size_hint = 117.72021681701133, avg_chars_size = 131.6642601804136, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 50 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59294) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:50.412817 [ 3154 ] {2841209b-5852-4a01-a80f-8b92f2e7ae6e} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 181 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39182) (comment: 00172_hits_joins.gen.sql) (in query: SELECT domain, hits, visits FROM ( SELECT domain(URL) AS domain, count() AS hits FROM test.hits GROUP BY domain ) ANY LEFT JOIN ( SELECT domain(StartURL) AS domain, sum(Sign) AS visits FROM test.visits GROUP BY domain ) USING domain ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:51.662415 [ 3976 ] {c7f78b4b-6d33-4dc1-a342-3a50c5635beb} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1368055 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59490) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:37:54.446378 [ 3182 ] {c81e30eb-e3fe-4aa2-8055-0797fe899756} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50774) (comment: 00148_monotonic_functions_and_index.sql) (in query: SELECT count() FROM test.hits WHERE CounterID < 732797 AND -CounterID < -107931;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:54.446378 [ 3990 ] {07ad4f79-42df-4a3a-82c6-6d8b8a949ece} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1173760 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:54424) (comment: 00084_external_aggregation.sql) (in query: SELECT URL, uniq(SearchPhrase) AS u FROM test.hits GROUP BY URL ORDER BY u DESC, URL LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9bb7 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>::resize(unsigned long, unsigned long) @ 0x000000003825fc9e in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/HashTable.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodString<HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>, HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodString<HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>&, HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x000000003825aa97 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodString<HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>, HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodString<HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>&, HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380c1ee9 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e523de in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:55.201040 [ 4381 ] {961f84b1-e236-4e74-bd2a-d7ac4a79c9e0} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1376319 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59476) (comment: 00224_shard_distributed_aggregation_memory_efficient_and_overflows.sql) (in query: SELECT count() = 200000 FROM remote('127.0.0.{2,3}', currentDatabase(), numbers_100k_log) GROUP BY number WITH TOTALS ORDER BY number LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::ReadBufferFromPocoSocket> std::make_shared[abi:v15000]<DB::ReadBufferFromPocoSocket, Poco::Net::StreamSocket&, void>(Poco::Net::StreamSocket&) @ 0x0000000039451c7f in /usr/bin/clickhouse
12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000003dd6c1b5 in /usr/bin/clickhouse
13. ./build_docker/./src/Client/Connection.cpp:435: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000003dd76efe in /usr/bin/clickhouse
14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:0: DB::ConnectionEstablisher::run(PoolWithFailoverBase<DB::IConnectionPool>::TryResult&, String&) @ 0x000000003ddd3b17 in /usr/bin/clickhouse
15. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003ddd7f7c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:37:56.483113 [ 2860 ] {42b6ec65-3706-4f8f-b680-0a492cf26c6a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1066041 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/gve/pzjldmmnbhecdifhlxaiewhwozyik, hash key: 4ba93978359451d5803ca62096d3c8a5, file_offset_of_buffer_end: 0, read_until_position: 359, internal buffer end: 359, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 42b6ec65-3706-4f8f-b680-0a492cf26c6a:17879, file segment info: File segment: [0, 358], key: 4ba93978359451d5803ca62096d3c8a5, state: DOWNLOADING, downloaded size: 0, reserved size: 359, downloader id: 42b6ec65-3706-4f8f-b680-0a492cf26c6a:17879, current write offset: 0, caller id: 42b6ec65-3706-4f8f-b680-0a492cf26c6a:17879, kind: Regular, unbound: 0: (while reading column ShareURL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42150) (comment: 00154_avro.sql) (in query: SELECT sum(cityHash64(*)) FROM (SELECT * FROM test.hits LIMIT 10000);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x00000000357922d0 in /usr/bin/clickhouse
20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a6245 in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad0b7 in /usr/bin/clickhouse
22. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
23. ./build_docker/./src/IO/ReadBuffer.h:72: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700a7d4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:37:56.483429 [ 6603 ] {022c40fb-83d8-4d7b-875c-0b470bf8d6c2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1572927 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (avg_value_size_hint = 109.6671142578125, avg_chars_size = 122.00053710937499, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 208 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41216) (comment: 00089_position_functions_with_non_constant_arg.sql) (in query: SELECT count() FROM test.hits WHERE positionCaseInsensitive(URL, 'metrika') != positionCaseInsensitive(URL, materialize('metrika'));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:37:59.640905 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:59.641017 [ 2751 ] {4f5349e2-d725-47da-97fd-553e8f22d51b} <Error> executeQuery: Code: 70. DB::Exception: IPv6 ::afff:102:304 in column IPv6 is not in IPv4 mapping block: While processing toIPv4(toIPv6('::afff:1.2.3.4')). (CANNOT_CONVERT_TYPE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42124) (comment: 02234_cast_to_ip_address.sql) (in query: SELECT toIPv4(toIPv6('::afff:1.2.3.4'));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char (&) [46], String>(int, FormatStringHelperImpl<std::type_identity<char (&) [46]>::type, std::type_identity<String>::type>, char (&) [46], String&&) @ 0x0000000009456ba1 in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ConvertImpl<DB::DataTypeIPv6, DB::DataTypeIPv4, DB::NameToIPv4, DB::ConvertDefaultBehaviorTag>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, void*) @ 0x0000000009ebca28 in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<DB::DataTypeIPv4, DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009e72715 in /usr/bin/clickhouse
5. DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009e64a93 in /usr/bin/clickhouse
6. DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009e632c2 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:37:59.641290 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:59.641642 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 5234550 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f47322 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:59.641695 [ 2552 ] {} <Error> test_ezi7inof.tableOut (4e3798b7-ae6d-4786-9b94-0a30f7acc669): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 86. DB::HTTPException: Received error from remote server /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02916%2Ftest_ezi7inof%2Ftable%2Freplicas%2F1&part=all_1_1_0&client_protocol_version=8&compress=false&remote_fs_metadata=s3. HTTP status code: 500 Internal Server Error, body: Code: 236. DB::Exception: Could not exchange part all_1_1_0 as it's in preActive state (1000 ms) and it uses zero copy replication. This is expected behaviour and the client will retry fetching the part automatically. (ABORTED) (version 23.8.16.41.altinitystable (altinity build)). (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000002103963b in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.h:27: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x0000000021038d5e in /usr/bin/clickhouse
4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000002102c3c1 in /usr/bin/clickhouse
5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000002102c0e5 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::callImpl(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002b15cf81 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::call(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x000000002b1651ce in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:379: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::initialize() @ 0x000000002b162802 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase<std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>>::ReadWriteBufferFromHTTPBase(std::shared_ptr<DB::UpdatableSession<DB::PooledSessionFactory>>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function<void (std::basic_ostream<char, std::char_traits<char>>&)>, unsigned long, DB::ReadSettings const&, std::vector<DB::HTTPHeaderEntry, std::allocator<DB::HTTPHeaderEntry>>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional<DB::HTTPFileInfo>, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x000000002b161b97 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function<void (std::basic_ostream<char, std::char_traits<char>>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x000000002b13fd7e in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::PooledReadWriteBufferFromHTTP>::__unique_single std::make_unique[abi:v15000]<DB::PooledReadWriteBufferFromHTTP, Poco::URI&, String const&, std::nullptr_t, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long, int, unsigned long>(Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x000000003cb9f95d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr<DB::Throttler>, bool, String const&, std::optional<DB::CurrentlySubmergingEmergingTagger>*, bool, std::shared_ptr<DB::IDisk>) @ 0x000000003cb77c3d in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::shared_ptr<DB::IMergeTreeDataPart> std::__function::__policy_invoker<std::shared_ptr<DB::IMergeTreeDataPart> ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_4, std::shared_ptr<DB::IMergeTreeDataPart> ()>>(std::__function::__policy_storage const*) @ 0x000000003c290209 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4620: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool) @ 0x000000003c057eff in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003c02bfb0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x000000003bff0e8a in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr<DB::ReplicatedMergeTreeQueue::SelectedEntry>)::$_1, bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>>(std::__function::__policy_storage const*, std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&) @ 0x000000003c289810 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ReplicatedMergeTreeQueue::processEntry(std::function<std::shared_ptr<zkutil::ZooKeeper> ()>, std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&, std::function<bool (std::shared_ptr<DB::ReplicatedMergeTreeLogEntry>&)>) @ 0x000000003d8c57ac in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr<DB::ReplicatedMergeTreeQueue::SelectedEntry>) @ 0x000000003c0bc836 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003c28c0df in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:37:59.641949 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_116_4}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1395589 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x00000000208b106a in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.cpp:0: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x000000003b1bed08 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::IColumn, DB::ColumnString>::clone() const @ 0x000000003b1dcc02 in /usr/bin/clickhouse
12. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
13. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:02.335902 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 5228317 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:02.335989 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4492221 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:02.336154 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4362748 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:02.336205 [ 18184 ] {} <Error> ExternalDictionariesLoader: Could not load external dictionary 'bc1e4e9f-8a71-44e3-af6d-4bde83ab7d7f', next update is scheduled at 2024-09-24 02:37:58: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 4206728 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9bb7 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable<unsigned long, HashMapCell<unsigned long, unsigned long, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, unsigned long>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>::resize(unsigned long, unsigned long) @ 0x000000002aa2b78a in /usr/bin/clickhouse
8. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::loadData() @ 0x000000002c1c40d9 in /usr/bin/clickhouse
9. DB::HashedArrayDictionary<(DB::DictionaryKeyType)0>::HashedArrayDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::HashedArrayDictionaryStorageConfiguration const&, std::shared_ptr<DB::Block>) @ 0x000000002c1c3902 in /usr/bin/clickhouse
10. DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_2::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, DB::DictionaryKeyType) const @ 0x000000002c1c2642 in /usr/bin/clickhouse
11. std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> std::__function::__policy_invoker<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::__call_impl<std::__function::__default_alloc_func<DB::registerDictionaryArrayHashed(DB::DictionaryFactory&)::$_0, std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>>(std::__function::__policy_storage const*, String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>&&, std::shared_ptr<DB::Context const>&&, bool) @ 0x000000002c1c15d1 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: std::function<std::unique_ptr<DB::IDictionary, std::default_delete<DB::IDictionary>> (String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool)>::operator()(String const&, DB::DictionaryStructure const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::IDictionarySource>, std::shared_ptr<DB::Context const>, bool) const @ 0x0000000035272e31 in /usr/bin/clickhouse
13. ./build_docker/./src/Dictionaries/DictionaryFactory.cpp:0: DB::DictionaryFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::Context const>, bool) const @ 0x000000003526fad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:40: DB::ExternalDictionariesLoader::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, String const&) const @ 0x0000000038cb5524 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc1340 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:02.336288 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 5209921 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:02.336313 [ 3186 ] {c326e351-249c-4b00-978c-2d9b6072cab8} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:49596) (comment: 02317_distinct_in_order_optimization_explain.sh) (in query: set allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:03.735215 [ 3994 ] {test_15_hash_table_sizes_stats_2161109} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 256 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59380) (comment: 02151_hash_table_sizes_stats.sh) (in query: -- size_hint = 1000005 despite the presence of limit --
 SELECT number FROM t_hash_table_sizes_stats_2377812225 GROUP BY number WITH CUBE LIMIT 5 SETTINGS max_threads = 5, group_by_two_level_threshold = 1000005, group_by_two_level_threshold_bytes = 1000005000 FORMAT Null;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:0: DB::ColumnString::insertData(char const*, unsigned long) @ 0x00000000395839a8 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ProfileEventsExt.cpp:0: ProfileEvents::getProfileEvents(String const&, std::shared_ptr<ConcurrentBoundedQueue<DB::Block>>, DB::Block&, std::unordered_map<unsigned long, ProfileEvents::Counters::Snapshot, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<std::pair<unsigned long const, ProfileEvents::Counters::Snapshot>>>&) @ 0x0000000039fc5102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::sendProfileEvents() @ 0x000000003e0d480c in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c35bd in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:03.735411 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_82_16}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 2037770 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:03.735381 [ 3239 ] {ee7c4788-f946-4afd-9f54-b8171fb963bd} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1830912 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (avg_value_size_hint = 117.72021681701133, avg_chars_size = 131.6642601804136, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 50 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:03.735509 [ 3182 ] {c81e30eb-e3fe-4aa2-8055-0797fe899756} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:03.735507 [ 3976 ] {c7f78b4b-6d33-4dc1-a342-3a50c5635beb} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1368055 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:38:03.735494 [ 3154 ] {2841209b-5852-4a01-a80f-8b92f2e7ae6e} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 181 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:03.735529 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2062074 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_5_5_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6656): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:03.735626 [ 2118 ] {a78d5639-91ea-4987-a5f5-151de26d9cc8} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59514) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:06.232099 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4194457 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x00000000208bc5ec in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<unsigned long>>::clone() const @ 0x000000003b422c66 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::savingThreadFunction() @ 0x000000003a3f41e2 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c42907 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c427df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:06.232222 [ 4381 ] {961f84b1-e236-4e74-bd2a-d7ac4a79c9e0} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1376319 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::ReadBufferFromPocoSocket> std::make_shared[abi:v15000]<DB::ReadBufferFromPocoSocket, Poco::Net::StreamSocket&, void>(Poco::Net::StreamSocket&) @ 0x0000000039451c7f in /usr/bin/clickhouse
12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000003dd6c1b5 in /usr/bin/clickhouse
13. ./build_docker/./src/Client/Connection.cpp:435: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000003dd76efe in /usr/bin/clickhouse
14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:0: DB::ConnectionEstablisher::run(PoolWithFailoverBase<DB::IConnectionPool>::TryResult&, String&) @ 0x000000003ddd3b17 in /usr/bin/clickhouse
15. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003ddd7f7c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:38:06.232221 [ 3990 ] {07ad4f79-42df-4a3a-82c6-6d8b8a949ece} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1173760 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<true, true>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a9bb7 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>::resize(unsigned long, unsigned long) @ 0x000000003825fc9e in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/HashTable.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodString<HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>, HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodString<HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>&, HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x000000003825aa97 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodString<HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>, HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodString<HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>&, HashMapTable<StringRef, HashMapCellWithSavedHash<StringRef, char*, StringRefHash64, HashTableNoState>, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380c1ee9 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e523de in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:06.232389 [ 6603 ] {022c40fb-83d8-4d7b-875c-0b470bf8d6c2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1572927 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (avg_value_size_hint = 109.6671142578125, avg_chars_size = 122.00053710937499, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 208 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:06.232456 [ 2860 ] {42b6ec65-3706-4f8f-b680-0a492cf26c6a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1066041 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/gve/pzjldmmnbhecdifhlxaiewhwozyik, hash key: 4ba93978359451d5803ca62096d3c8a5, file_offset_of_buffer_end: 0, read_until_position: 359, internal buffer end: 359, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 42b6ec65-3706-4f8f-b680-0a492cf26c6a:17879, file segment info: File segment: [0, 358], key: 4ba93978359451d5803ca62096d3c8a5, state: DOWNLOADING, downloaded size: 0, reserved size: 359, downloader id: 42b6ec65-3706-4f8f-b680-0a492cf26c6a:17879, current write offset: 0, caller id: 42b6ec65-3706-4f8f-b680-0a492cf26c6a:17879, kind: Regular, unbound: 0: (while reading column ShareURL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x00000000357922d0 in /usr/bin/clickhouse
20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a6245 in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad0b7 in /usr/bin/clickhouse
22. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
23. ./build_docker/./src/IO/ReadBuffer.h:72: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700a7d4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:38:06.232716 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_76_17}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1076047 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:07.030113 [ 3983 ] {1cc30150-b405-41a7-83aa-d9bd5a2853d4} <Error> executeQuery: Code: 6. DB::Exception: Cannot parse force_data_skipping_indices (''). (CANNOT_PARSE_TEXT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 SETTINGS force_data_skipping_indices='';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:915: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eabe2 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:07.030128 [ 2537 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:07.030352 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:07.030286 [ 2751 ] {4f5349e2-d725-47da-97fd-553e8f22d51b} <Error> TCPHandler: Code: 70. DB::Exception: IPv6 ::afff:102:304 in column IPv6 is not in IPv4 mapping block: While processing toIPv4(toIPv6('::afff:1.2.3.4')). (CANNOT_CONVERT_TYPE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char (&) [46], String>(int, FormatStringHelperImpl<std::type_identity<char (&) [46]>::type, std::type_identity<String>::type>, char (&) [46], String&&) @ 0x0000000009456ba1 in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ConvertImpl<DB::DataTypeIPv6, DB::DataTypeIPv4, DB::NameToIPv4, DB::ConvertDefaultBehaviorTag>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, void*) @ 0x0000000009ebca28 in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<DB::DataTypeIPv4, DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009e72715 in /usr/bin/clickhouse
5. DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009e64a93 in /usr/bin/clickhouse
6. DB::FunctionConvert<DB::DataTypeIPv4, DB::NameToIPv4, DB::ToNumberMonotonicity<unsigned int>>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009e632c2 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:38:07.030430 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1185823 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:07.030524 [ 2419 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:07.030687 [ 3186 ] {c326e351-249c-4b00-978c-2d9b6072cab8} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:08.159798 [ 2759 ] {b42c8eee-381e-4d67-bb87-6c46f62c1d21} <Error> DynamicQueryHandler: Code: 271. DB::Exception: Invalid zero byte count(s): 5 and 1. (CANNOT_DECOMPRESS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned int&, unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned int&>::type, std::type_identity<unsigned int&>::type>, unsigned int&, unsigned int&) @ 0x00000000349c9a0d in /usr/bin/clickhouse
3. ./build_docker/./src/Compression/CompressionCodecFPC.cpp:0: DB::CompressionCodecFPC::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x00000000369b996f in /usr/bin/clickhouse
4. ./build_docker/./src/Compression/ICompressionCodec.cpp:112: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x00000000369cfaaa in /usr/bin/clickhouse
5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:308: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x00000000368ab1a3 in /usr/bin/clickhouse
6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x00000000368a5253 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper<std::nullptr_t>::nextImpl() @ 0x0000000036204997 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x00000000377fda03 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadBuffer.h:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9ac740 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:08.160070 [ 3994 ] {test_15_hash_table_sizes_stats_2161109} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 256 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:0: DB::ColumnString::insertData(char const*, unsigned long) @ 0x00000000395839a8 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ProfileEventsExt.cpp:0: ProfileEvents::getProfileEvents(String const&, std::shared_ptr<ConcurrentBoundedQueue<DB::Block>>, DB::Block&, std::unordered_map<unsigned long, ProfileEvents::Counters::Snapshot, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<std::pair<unsigned long const, ProfileEvents::Counters::Snapshot>>>&) @ 0x0000000039fc5102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::sendProfileEvents() @ 0x000000003e0d480c in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c35bd in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:08.160236 [ 2118 ] {a78d5639-91ea-4987-a5f5-151de26d9cc8} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:08.160519 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_1_66_13}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:08.162803 [ 3983 ] {1cc30150-b405-41a7-83aa-d9bd5a2853d4} <Error> TCPHandler: Code: 6. DB::Exception: Cannot parse force_data_skipping_indices (''). (CANNOT_PARSE_TEXT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:915: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eabe2 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:08.162953 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:08.164436 [ 2317 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:08.248763 [ 2759 ] {99bb8ef6-88df-4585-b3e7-0296e03fa560} <Error> DynamicQueryHandler: Code: 271. DB::Exception: Invalid zero byte count(s): 1 and 6. (CANNOT_DECOMPRESS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned int&, unsigned int&>(int, FormatStringHelperImpl<std::type_identity<unsigned int&>::type, std::type_identity<unsigned int&>::type>, unsigned int&, unsigned int&) @ 0x00000000349c9a0d in /usr/bin/clickhouse
3. ./build_docker/./src/Compression/CompressionCodecFPC.cpp:0: DB::CompressionCodecFPC::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x00000000369b996f in /usr/bin/clickhouse
4. ./build_docker/./src/Compression/ICompressionCodec.cpp:112: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x00000000369cfaaa in /usr/bin/clickhouse
5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:308: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x00000000368ab1a3 in /usr/bin/clickhouse
6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x00000000368a5253 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper<std::nullptr_t>::nextImpl() @ 0x0000000036204997 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x00000000377fda03 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadBuffer.h:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9ac740 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:09.402739 [ 3983 ] {e7239991-5d51-42ce-992c-1289e687f235} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 SETTINGS force_data_skipping_indices='d1_idx';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:11.000796 [ 2375 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:11.006420 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:11.006429 [ 2759 ] {f1183aef-9cb1-4839-8339-83e886285d9c} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56612) (comment: 02317_distinct_in_order_optimization_explain.sh) (in query: set allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:11.010718 [ 2751 ] {0559ad9f-5627-4bac-8c98-7322ed2ecf60} <Error> executeQuery: Code: 675. DB::Exception: Invalid IPv4 value: While processing CAST('test', 'IPv4'). (CANNOT_PARSE_IPV4) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42124) (comment: 02234_cast_to_ip_address.sql) (in query: SELECT cast('test' , 'IPv4');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [19]>(int, char const (&) [19]) @ 0x0000000009447077 in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::convertToIPv4<(DB::IPStringToNumExceptionMode)0, DB::ColumnVector<DB::IPv4>>(COW<DB::IColumn>::immutable_ptr<DB::IColumn>, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x00000000094468cf in /usr/bin/clickhouse
4. bool DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const::'lambda0'(auto const&)::operator()<DB::TypePair<DB::DataTypeString, DB::DataTypeIPv4>>(auto const&) const::'lambda'(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)::operator()(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long) const @ 0x000000000a2a93fd in /usr/bin/clickhouse
5. COW<DB::IColumn>::immutable_ptr<DB::IColumn> std::__function::__policy_invoker<COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)>::__call_impl<std::__function::__default_alloc_func<bool DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const::'lambda0'(auto const&)::operator()<DB::TypePair<DB::DataTypeString, DB::DataTypeIPv4>>(auto const&) const::'lambda'(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long), COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)>>(std::__function::__policy_storage const*, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long) @ 0x000000000a2a910e in /usr/bin/clickhouse
6. DB::ExecutableFunctionCast::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000094107f8 in /usr/bin/clickhouse
7. DB::IExecutableFunction::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000094111c2 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2303 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:38:11.915620 [ 3983 ] {e7239991-5d51-42ce-992c-1289e687f235} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:11.920609 [ 3989 ] {2016ea45-5347-418d-a256-81eb03b3214e} <Error> executeQuery: Code: 62. DB::Exception: Syntax error: failed at position 8 ('('): ([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([. Unmatched parentheses: ([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([. (SYNTAX_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37162) (comment: 00984_parser_stack_overflow.sh) (in query: SELECT ([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/Parsers/parseQuery.cpp:363: DB::parseQueryAndMovePosition(DB::IParser&, char const*&, char const*, String const&, bool, unsigned long, unsigned long) @ 0x000000003ff20d3b in /usr/bin/clickhouse
4. ./build_docker/./src/Parsers/parseQuery.cpp:375: DB::parseQuery(DB::IParser&, char const*, char const*, String const&, unsigned long, unsigned long) @ 0x000000003ff20e90 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a99778c in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
8. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:12.196676 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 8650815 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:14.091860 [ 3992 ] {7ea79fcf-23fa-460e-b2ad-cdf9d99985df} <Error> DynamicQueryHandler: Code: 271. DB::Exception: Cannot decompress, the number of elements in the compressed data (65) is not equal to the expected number of elements in the decompressed data (1). (CANNOT_DECOMPRESS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, unsigned long&, unsigned long&) @ 0x000000000c80250c in /usr/bin/clickhouse
3. ./build_docker/./src/Compression/CompressionCodecT64.cpp:0: DB::CompressionCodecT64::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x000000003691f1af in /usr/bin/clickhouse
4. ./build_docker/./src/Compression/ICompressionCodec.cpp:112: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x00000000369cfaaa in /usr/bin/clickhouse
5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:308: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x00000000368ab1a3 in /usr/bin/clickhouse
6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x00000000368a5253 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper<std::nullptr_t>::nextImpl() @ 0x0000000036204997 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x00000000377fda03 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/ReadBuffer.h:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9ac740 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:14.091910 [ 2759 ] {f1183aef-9cb1-4839-8339-83e886285d9c} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:14.092028 [ 3987 ] {} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000035e1bd4e in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1904: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x00000000378b8175 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x000000003e0df937 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x000000003e0bf4be in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:14.092028 [ 2751 ] {0559ad9f-5627-4bac-8c98-7322ed2ecf60} <Error> TCPHandler: Code: 675. DB::Exception: Invalid IPv4 value: While processing CAST('test', 'IPv4'). (CANNOT_PARSE_IPV4), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [19]>(int, char const (&) [19]) @ 0x0000000009447077 in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::convertToIPv4<(DB::IPStringToNumExceptionMode)0, DB::ColumnVector<DB::IPv4>>(COW<DB::IColumn>::immutable_ptr<DB::IColumn>, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x00000000094468cf in /usr/bin/clickhouse
4. bool DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const::'lambda0'(auto const&)::operator()<DB::TypePair<DB::DataTypeString, DB::DataTypeIPv4>>(auto const&) const::'lambda'(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)::operator()(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long) const @ 0x000000000a2a93fd in /usr/bin/clickhouse
5. COW<DB::IColumn>::immutable_ptr<DB::IColumn> std::__function::__policy_invoker<COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)>::__call_impl<std::__function::__default_alloc_func<bool DB::FunctionCast<DB::CastName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const::'lambda0'(auto const&)::operator()<DB::TypePair<DB::DataTypeString, DB::DataTypeIPv4>>(auto const&) const::'lambda'(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long), COW<DB::IColumn>::immutable_ptr<DB::IColumn> (std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long)>>(std::__function::__policy_storage const*, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&, std::shared_ptr<DB::IDataType const> const&, DB::ColumnNullable const*, unsigned long) @ 0x000000000a2a910e in /usr/bin/clickhouse
6. DB::ExecutableFunctionCast::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000094107f8 in /usr/bin/clickhouse
7. DB::IExecutableFunction::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000094111c2 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2303 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:38:14.092227 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4974877 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:18.155763 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4196397 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:18.155903 [ 3101 ] {4d4cb54d-c895-4425-9a15-ffa24dcd3fc3} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1196000 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56598) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:20.449551 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:20.449759 [ 3982 ] {36e3e621-3c55-41a4-8517-ac71f90f5b35} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56630) (comment: 00156_max_execution_speed_sample_merge.sql) (in query: SELECT count() FROM test.hits SAMPLE 1 / 2;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:20.449803 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4284567 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:20.449843 [ 3989 ] {2016ea45-5347-418d-a256-81eb03b3214e} <Error> DynamicQueryHandler: Code: 62. DB::Exception: Syntax error: failed at position 8 ('('): ([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([. Unmatched parentheses: ([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([([. (SYNTAX_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/Parsers/parseQuery.cpp:363: DB::parseQueryAndMovePosition(DB::IParser&, char const*&, char const*, String const&, bool, unsigned long, unsigned long) @ 0x000000003ff20d3b in /usr/bin/clickhouse
4. ./build_docker/./src/Parsers/parseQuery.cpp:375: DB::parseQuery(DB::IParser&, char const*, char const*, String const&, unsigned long, unsigned long) @ 0x000000003ff20e90 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a99778c in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
8. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:20.449948 [ 2349 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:20.449982 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 4339901 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:20.450005 [ 2351 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:22.066481 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 4208573 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:22.067076 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_66_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:22.066794 [ 3992 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:22.066894 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 5136341 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:22.067474 [ 2782 ] {0d86e6c3-622c-4f51-b43d-5a1af6af66a9} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: common/fsr/xwfhjoclplsqkhzesvqbmfoodqqgm, hash key: 7e1d1995599f108e0c4de33eae615a32, file_offset_of_buffer_end: 61314, read_until_position: 108193, internal buffer end: 670068, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:3059, file segment info: File segment: [0, 670067], key: 7e1d1995599f108e0c4de33eae615a32, state: DOWNLOADING, downloaded size: 0, reserved size: 61314, downloader id: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:3059, current write offset: 0, caller id: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:3059, kind: Regular, unbound: 0: (while reading column SearchEngineID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 26 with max_rows_to_read = 92160): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56700) (comment: 00035_aggregate_keys128.sql) (in query: SELECT SearchEngineID AS k1, AdvEngineID AS k2, count() AS c FROM test.hits GROUP BY k1, k2 ORDER BY c DESC, k1, k2 LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:22.066918 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.65 GiB (attempt to allocate chunk of 4194433 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x00000000208bc5ec in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<unsigned long>>::clone() const @ 0x000000003b422c66 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::savingThreadFunction() @ 0x000000003a3f41e2 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c42907 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c427df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:22.622777 [ 2939 ] {baffefcd-2d69-4318-bf85-f08fcfe15306} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1704063 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56682) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnFixedString.cpp:339: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnFixedString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b0c887a in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnFixedString.cpp:314: DB::ColumnFixedString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08c97c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3f104 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:24.177119 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4218943 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:24.177124 [ 3101 ] {4d4cb54d-c895-4425-9a15-ffa24dcd3fc3} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1196000 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:24.177259 [ 3983 ] {048c679a-2fdb-4fc8-8fe9-3099ef3a1a02} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 SETTINGS force_data_skipping_indices='d1_null_idx';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:24.177119 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 4853533 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:24.177186 [ 3982 ] {36e3e621-3c55-41a4-8517-ac71f90f5b35} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:24.177286 [ 2406 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:24.177128 [ 3232 ] {c528f510-714c-4cb5-9d87-a4b87d606e69} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1576960 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56618) (comment: 00043_any_left_join.sql) (in query: SELECT EventDate, count() AS hits, any(visits) FROM test.hits ANY LEFT JOIN ( SELECT StartDate AS EventDate, sum(Sign) AS visits FROM test.visits GROUP BY EventDate ) USING EventDate GROUP BY EventDate ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: DB::HashJoin::MapsTemplate<DB::RowRef>::create(DB::HashJoin::Type) @ 0x00000000391a670d in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/constexpr_helpers.h:0: DB::HashJoin::dataMapInit(std::variant<DB::HashJoin::MapsTemplate<DB::RowRef>, DB::HashJoin::MapsTemplate<DB::RowRefList>, DB::HashJoin::MapsTemplate<std::unique_ptr<DB::SortedLookupVectorBase, std::default_delete<DB::SortedLookupVectorBase>>>>&, unsigned long) @ 0x0000000038d563d0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::HashJoin::HashJoin(std::shared_ptr<DB::TableJoin>, DB::Block const&, bool, unsigned long) @ 0x0000000038d52289 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::ConcurrentHashJoin::ConcurrentHashJoin(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::TableJoin>, unsigned long, DB::Block const&, bool) @ 0x0000000038c73a01 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr<DB::ConcurrentHashJoin> std::allocate_shared[abi:v15000]<DB::ConcurrentHashJoin, std::allocator<DB::ConcurrentHashJoin>, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::TableJoin>&, DB::SettingFieldMaxThreads const&, DB::Block&, void>(std::allocator<DB::ConcurrentHashJoin> const&, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::TableJoin>&, DB::SettingFieldMaxThreads const&, DB::Block&) @ 0x0000000037d0f193 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc2503 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:38:24.177396 [ 2397 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:24.177482 [ 3994 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:25.520823 [ 2564 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Removing temporary directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/
2024.09.24 02:38:25.521317 [ 2564 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/
2024.09.24 02:38:26.635574 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DataPartStorageOnDiskBase::clearDirectory(String const&, DB::CanRemoveDescription const&, DB::MergeTreeDataPartChecksums const&, bool, Poco::Logger*) @ 0x000000003cc0ffc2 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc07a06 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:26.635685 [ 2939 ] {baffefcd-2d69-4318-bf85-f08fcfe15306} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1704063 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnFixedString.cpp:339: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnFixedString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b0c887a in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnFixedString.cpp:314: DB::ColumnFixedString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08c97c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3f104 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:26.635736 [ 2782 ] {0d86e6c3-622c-4f51-b43d-5a1af6af66a9} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: common/vpp/ylvoltryowjqrnebzkxceyoprekfw, hash key: 8d5c415c9b8d545c02ad2a3b7bd38c14, file_offset_of_buffer_end: 0, read_until_position: 45592, internal buffer end: 459400, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:2835, file segment info: File segment: [0, 459399], key: 8d5c415c9b8d545c02ad2a3b7bd38c14, state: DOWNLOADING, downloaded size: 0, reserved size: 459400, downloader id: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:2835, current write offset: 0, caller id: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:2835, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
23. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:26.635770 [ 3154 ] {cf873ca2-a29f-40ba-98d1-7da586e4d9b5} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44036) (comment: 02317_distinct_in_order_optimization_explain.sh) (in query: set allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:28.738119 [ 2751 ] {fc7c6964-b096-4cf6-9b61-b2c94d2bfea8} <Error> executeQuery: Code: 676. DB::Exception: Invalid IPv6 value: While processing IPv6StringToNum('test'). (CANNOT_PARSE_IPV6) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42124) (comment: 02234_cast_to_ip_address.sql) (in query: SELECT IPv6StringToNum('test');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [19]>(int, char const (&) [19]) @ 0x0000000009447077 in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::detail::convertToIPv6<(DB::IPStringToNumExceptionMode)0, DB::ColumnFixedString, DB::ColumnString>(DB::ColumnString const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000000a9e1a1d in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::convertToIPv6<(DB::IPStringToNumExceptionMode)0, DB::ColumnFixedString>(COW<DB::IColumn>::immutable_ptr<DB::IColumn>, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000000a9dd40c in /usr/bin/clickhouse
5. DB::FunctionIPv6StringToNum<(DB::IPStringToNumExceptionMode)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a9db185 in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:38:29.828497 [ 3976 ] {50872718-ba53-4cc3-b459-7e718ddfbc07} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 411.82 MiB (attempt to allocate chunk of 1048704 bytes), maximum: 9.31 GiB: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56684) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
8. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
23. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:29.828814 [ 3186 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:29.828887 [ 3983 ] {048c679a-2fdb-4fc8-8fe9-3099ef3a1a02} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:29.828887 [ 3232 ] {c528f510-714c-4cb5-9d87-a4b87d606e69} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1576960 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: DB::HashJoin::MapsTemplate<DB::RowRef>::create(DB::HashJoin::Type) @ 0x00000000391a670d in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/constexpr_helpers.h:0: DB::HashJoin::dataMapInit(std::variant<DB::HashJoin::MapsTemplate<DB::RowRef>, DB::HashJoin::MapsTemplate<DB::RowRefList>, DB::HashJoin::MapsTemplate<std::unique_ptr<DB::SortedLookupVectorBase, std::default_delete<DB::SortedLookupVectorBase>>>>&, unsigned long) @ 0x0000000038d563d0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::HashJoin::HashJoin(std::shared_ptr<DB::TableJoin>, DB::Block const&, bool, unsigned long) @ 0x0000000038d52289 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::ConcurrentHashJoin::ConcurrentHashJoin(std::shared_ptr<DB::Context const>, std::shared_ptr<DB::TableJoin>, unsigned long, DB::Block const&, bool) @ 0x0000000038c73a01 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr<DB::ConcurrentHashJoin> std::allocate_shared[abi:v15000]<DB::ConcurrentHashJoin, std::allocator<DB::ConcurrentHashJoin>, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::TableJoin>&, DB::SettingFieldMaxThreads const&, DB::Block&, void>(std::allocator<DB::ConcurrentHashJoin> const&, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::TableJoin>&, DB::SettingFieldMaxThreads const&, DB::Block&) @ 0x0000000037d0f193 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc2503 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse

2024.09.24 02:38:29.829271 [ 2377 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:29.829588 [ 2438 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:29.829708 [ 3154 ] {cf873ca2-a29f-40ba-98d1-7da586e4d9b5} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:29.829986 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> void DB::IMergeTreeDataPart::removeIfNeeded(): while removing part all_1_1_1_4 with path store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While committing metadata operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DataPartStorageOnDiskBase::clearDirectory(String const&, DB::CanRemoveDescription const&, DB::MergeTreeDataPartChecksums const&, bool, Poco::Logger*) @ 0x000000003cc0ffc2 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc07a06 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:31.542648 [ 2751 ] {fc7c6964-b096-4cf6-9b61-b2c94d2bfea8} <Error> TCPHandler: Code: 676. DB::Exception: Invalid IPv6 value: While processing IPv6StringToNum('test'). (CANNOT_PARSE_IPV6), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [19]>(int, char const (&) [19]) @ 0x0000000009447077 in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::detail::convertToIPv6<(DB::IPStringToNumExceptionMode)0, DB::ColumnFixedString, DB::ColumnString>(DB::ColumnString const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000000a9e1a1d in /usr/bin/clickhouse
4. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::convertToIPv6<(DB::IPStringToNumExceptionMode)0, DB::ColumnFixedString>(COW<DB::IColumn>::immutable_ptr<DB::IColumn>, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000000a9dd40c in /usr/bin/clickhouse
5. DB::FunctionIPv6StringToNum<(DB::IPStringToNumExceptionMode)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a9db185 in /usr/bin/clickhouse
6. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
7. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse

2024.09.24 02:38:31.543062 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:31.543132 [ 2782 ] {0d86e6c3-622c-4f51-b43d-5a1af6af66a9} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: common/fsr/xwfhjoclplsqkhzesvqbmfoodqqgm, hash key: 7e1d1995599f108e0c4de33eae615a32, file_offset_of_buffer_end: 61314, read_until_position: 108193, internal buffer end: 670068, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:3059, file segment info: File segment: [0, 670067], key: 7e1d1995599f108e0c4de33eae615a32, state: DOWNLOADING, downloaded size: 0, reserved size: 61314, downloader id: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:3059, current write offset: 0, caller id: 0d86e6c3-622c-4f51-b43d-5a1af6af66a9:3059, kind: Regular, unbound: 0: (while reading column SearchEngineID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 26 with max_rows_to_read = 92160): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:31.544965 [ 4381 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.71 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:31.543052 [ 2564 ] {} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/, errno: 2, strerror: No such file or directory. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:31.643466 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1113973 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x00000000208b106a in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.cpp:0: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x000000003b1bed08 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::IColumn, DB::ColumnString>::clone() const @ 0x000000003b1dcc02 in /usr/bin/clickhouse
12. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
13. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:37.031765 [ 2560 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Removing temporary directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/
2024.09.24 02:38:37.031897 [ 2560 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/
2024.09.24 02:38:39.060262 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 8650815 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:56: DB::MergedColumnOnlyOutputStream::write(DB::Block const&) @ 0x000000003d679929 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::PartMergerWriter::mutateOriginalPartAndPrepareProjections() @ 0x000000003d69a079 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:0: DB::MutateSomePartColumnsTask::executeStep() @ 0x000000003d6fc7f4 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x000000003d69f9b2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad5f1d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:39.060256 [ 3991 ] {test_15_hash_table_sizes_stats_71241283} <Error> PullingAsyncPipelineExecutor: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing CubeTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned long>::reserve(unsigned long) @ 0x000000003b2ca360 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/AggregationUtils.cpp:0: DB::prepareOutputBlockColumns(DB::Aggregator::Params const&, std::vector<DB::IAggregateFunction const*, std::allocator<DB::IAggregateFunction const*>> const&, DB::Block const&, std::vector<std::shared_ptr<DB::Arena>, std::allocator<std::shared_ptr<DB::Arena>>>&, bool, unsigned long) @ 0x0000000038c695c9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: std::conditional<true, DB::Block, std::list<DB::Block, std::allocator<DB::Block>>>::type DB::Aggregator::convertToBlockImplNotFinal<true, DB::AggregationMethodOneNumber<unsigned long, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::AggregationMethodOneNumber<unsigned long, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, std::vector<std::shared_ptr<DB::Arena>, std::allocator<std::shared_ptr<DB::Arena>>>&, unsigned long) const::'lambda'()::operator()() const @ 0x0000000038a12590 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: std::conditional<true, DB::Block, std::list<DB::Block, std::allocator<DB::Block>>>::type DB::Aggregator::convertToBlockImplNotFinal<true, DB::AggregationMethodOneNumber<unsigned long, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::AggregationMethodOneNumber<unsigned long, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, std::vector<std::shared_ptr<DB::Arena>, std::allocator<std::shared_ptr<DB::Arena>>>&, unsigned long) const @ 0x0000000038a0f082 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/Aggregator.cpp:0: std::conditional<true, DB::Block, std::list<DB::Block, std::allocator<DB::Block>>>::type DB::Aggregator::convertToBlockImpl<true, DB::AggregationMethodOneNumber<unsigned long, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::AggregationMethodOneNumber<unsigned long, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, DefaultHash<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, DefaultHash<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, DB::Arena*, std::vector<std::shared_ptr<DB::Arena>, std::allocator<std::shared_ptr<DB::Arena>>>&, bool, unsigned long) const @ 0x00000000389ca07f in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/Aggregator.cpp:0: std::conditional<true, DB::Block, std::list<DB::Block, std::allocator<DB::Block>>>::type DB::Aggregator::prepareBlockAndFillSingleLevel<true>(DB::AggregatedDataVariants&, bool) const @ 0x00000000380c85cd in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e5c369 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Transforms/RollupTransform.cpp:0: DB::GroupByModifierTransform::merge(std::vector<DB::Chunk, std::allocator<DB::Chunk>>&&, bool, bool) @ 0x000000003f0ac4b1 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/RollupTransform.cpp:36: DB::GroupByModifierTransform::mergeConsumed() @ 0x000000003f0a9cbc in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:88: DB::CubeTransform::generate() @ 0x000000003f0a4bfe in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/IAccumulatingTransform.cpp:93: DB::IAccumulatingTransform::work() @ 0x000000003eb62b48 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:39.060396 [ 2368 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:39.060555 [ 2384 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:39.060649 [ 2950 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:39.060895 [ 2564 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::lambda}: Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/, errno: 2, strerror: No such file or directory: While committing metadata operation #0. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:39.061126 [ 3976 ] {50872718-ba53-4cc3-b459-7e718ddfbc07} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 411.82 MiB (attempt to allocate chunk of 1048704 bytes), maximum: 9.31 GiB: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
8. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
23. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:39.061191 [ 3154 ] {e72c863d-2a5f-46c2-a559-98293d816263} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59732) (comment: 02317_distinct_in_order_optimization_explain.sh) (in query: set allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:39.061318 [ 2905 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:40.576830 [ 2536 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:41.419414 [ 3983 ] {26d0d5a6-f574-4e0b-83e5-ac4f7c5ffbd5} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 WHERE d1 = 0 SETTINGS force_data_skipping_indices='d1_idx,d1_null_idx';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:49.835602 [ 6598 ] {24fa8192-734e-4bd2-a814-3284a1bfa071} <Error> executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59692) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910 ADD COLUMN j2 Tuple(JSON) DEFAULT jString;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [114]>(int, char const (&) [114]) @ 0x0000000036ad3f77 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92ebd0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:49.835826 [ 3232 ] {abf14312-e8f1-45e1-884f-c394e906a521} <Error> executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59782) (in query: select _path,_file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:49.835853 [ 3186 ] {e5d30d7e-71a1-46ce-a290-f12fc2464d0e} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1146848 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59698) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:49.835894 [ 3239 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:49.835919 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4297149 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:50.584397 [ 3154 ] {e72c863d-2a5f-46c2-a559-98293d816263} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:50.584580 [ 2407 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:50.584623 [ 2347 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:50.584670 [ 2939 ] {9e08a6a6-f69b-4043-a8f3-27ff63f89159} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59694) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:50.588863 [ 3991 ] {test_15_hash_table_sizes_stats_71241283} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56586) (comment: 02151_hash_table_sizes_stats.sh) (in query: -- size_hint = 1000005 despite the presence of limit --
 SELECT number FROM t_hash_table_sizes_stats_2377812225 GROUP BY number WITH CUBE LIMIT 5 SETTINGS max_threads = 5, group_by_two_level_threshold = 1000005, group_by_two_level_threshold_bytes = 1000005000 FORMAT Null;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000a7245b1 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<signed char>::insert(DB::Field const&) @ 0x000000003b315f4e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ProfileEventsExt.cpp:78: ProfileEvents::getProfileEvents(String const&, std::shared_ptr<ConcurrentBoundedQueue<DB::Block>>, DB::Block&, std::unordered_map<unsigned long, ProfileEvents::Counters::Snapshot, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<std::pair<unsigned long const, ProfileEvents::Counters::Snapshot>>>&) @ 0x0000000039fc562f in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::sendProfileEvents() @ 0x000000003e0d480c in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c35bd in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:51.504814 [ 2751 ] {f05a35c0-1bfe-4425-b6e4-7d6a510aeaec} <Error> executeQuery: Code: 676. DB::ParsingException: Cannot parse IPv6 test: Cannot parse IPv6 from String: While processing toIPv6('test'). (CANNOT_PARSE_IPV6) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42124) (comment: 02234_cast_to_ip_address.sql) (in query: SELECT toIPv6('test');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::ParsingException::ParsingException<std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000009e613bb in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ConvertThroughParsing<DB::DataTypeString, DB::DataTypeIPv6, DB::NameToIPv6, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, void*) @ 0x0000000009f1f389 in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<DB::DataTypeIPv6, DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009ee17f5 in /usr/bin/clickhouse
5. DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009ed49b3 in /usr/bin/clickhouse
6. DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009ed31e2 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:38:53.572658 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 4195445 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const*, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const*) @ 0x000000003b3d8270 in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>::clone() const @ 0x000000003b425026 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4387f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:53.572738 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 4399470 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:53.572874 [ 3983 ] {26d0d5a6-f574-4e0b-83e5-ac4f7c5ffbd5} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:53.573072 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1}: Code: 84. DB::Exception: Directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/ already exists. (DIRECTORY_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:185: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc824d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:53.573560 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:55.375687 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmpe351d309-902c-4b96-a83b-783331412e33' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:38:57.002759 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 4194814 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.002833 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 4303106 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.003015 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 4231422 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.003047 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 5191036 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.003116 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 4198589 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.003332 [ 3989 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.003339 [ 6598 ] {24fa8192-734e-4bd2-a814-3284a1bfa071} <Error> TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [114]>(int, char const (&) [114]) @ 0x0000000036ad3f77 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92ebd0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:57.003442 [ 3232 ] {abf14312-e8f1-45e1-884f-c394e906a521} <Error> TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:57.003507 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_78_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1049303 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/202409_1_77_18/ in table system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 8692): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:159: DB::ReverseIndex<unsigned long, DB::ColumnString>::insert(StringRef) @ 0x0000000036b50819 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnUnique.h:0: COW<DB::IColumn>::mutable_ptr<DB::IColumn> DB::ColumnUnique<DB::ColumnString>::uniqueInsertRangeImpl<char8_t>(DB::IColumn const&, unsigned long, unsigned long, unsigned long, DB::ColumnVector<char8_t>::MutablePtr&&, DB::ReverseIndex<unsigned long, DB::ColumnString>*, unsigned long) @ 0x0000000036b488be in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: COW<DB::IColumn>::mutable_ptr<DB::IColumn> DB::ColumnUnique<DB::ColumnString>::uniqueInsertRangeFrom(DB::IColumn const&, unsigned long, unsigned long)::'lambda'(auto)::operator()<char8_t>(auto) const @ 0x0000000036b46cf1 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnUnique.h:0: DB::ColumnUnique<DB::ColumnString>::uniqueInsertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x0000000036b41c5c in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::insertRangeFromDictionaryEncodedColumn(DB::IColumn const&, DB::IColumn const&) @ 0x000000003b0f40c8 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036f50999 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.003620 [ 3186 ] {e5d30d7e-71a1-46ce-a290-f12fc2464d0e} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1146848 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:57.003523 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_66_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1049571 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435e51 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:322: DB::ColumnVector<long>::insertDefault() @ 0x000000003b354a15 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::ColumnSparse(COW<DB::IColumn>::mutable_ptr<DB::IColumn>&&) @ 0x000000003b1a1813 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::IDataType::createColumn(DB::ISerialization const&) const @ 0x0000000036dd5efa in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:140: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d473eda in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.003689 [ 3991 ] {test_15_hash_table_sizes_stats_71241283} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000a7245b1 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<signed char>::insert(DB::Field const&) @ 0x000000003b315f4e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ProfileEventsExt.cpp:78: ProfileEvents::getProfileEvents(String const&, std::shared_ptr<ConcurrentBoundedQueue<DB::Block>>, DB::Block&, std::unordered_map<unsigned long, ProfileEvents::Counters::Snapshot, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<std::pair<unsigned long const, ProfileEvents::Counters::Snapshot>>>&) @ 0x0000000039fc562f in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::sendProfileEvents() @ 0x000000003e0d480c in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c35bd in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:57.003937 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_79_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1141183 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.899860 [ 2536 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.899871 [ 4381 ] {f0498671-9a27-4e5d-a3e6-07c6eba0b546} <Error> executeQuery: Code: 253. DB::Exception: Replica /clickhouse/tables/db_01530_atomic/db_01530_atomic/data/replicas/test already exists. (REPLICA_ALREADY_EXISTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59746) (comment: 01530_drop_database_atomic_sync.sql) (in query: CREATE TABLE db_01530_atomic.data (`key` Int) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{database}/db_01530_atomic/data', 'test') ORDER BY key SETTINGS index_granularity = 31170, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 16375, prefer_fetch_merged_part_size_threshold = 2544656883, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 22189118, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 96269, primary_key_compress_block_size = 84689), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::createReplica(std::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x000000003bf7edb2 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:538: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool) @ 0x000000003bf4c82c in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageReplicatedMergeTree> std::allocate_shared[abi:v15000]<DB::StorageReplicatedMergeTree, std::allocator<DB::StorageReplicatedMergeTree>, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator<DB::StorageReplicatedMergeTree> const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x000000003da14334 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da076e2 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:57.899906 [ 2939 ] {9e08a6a6-f69b-4043-a8f3-27ff63f89159} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:38:57.900038 [ 2751 ] {f05a35c0-1bfe-4425-b6e4-7d6a510aeaec} <Error> TCPHandler: Code: 676. DB::ParsingException: Cannot parse IPv6 test: Cannot parse IPv6 from String: While processing toIPv6('test'). (CANNOT_PARSE_IPV6), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::ParsingException::ParsingException<std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000009e613bb in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ConvertThroughParsing<DB::DataTypeString, DB::DataTypeIPv6, DB::NameToIPv6, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, void*) @ 0x0000000009f1f389 in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<DB::DataTypeIPv6, DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009ee17f5 in /usr/bin/clickhouse
5. DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009ed49b3 in /usr/bin/clickhouse
6. DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009ed31e2 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:38:57.900185 [ 2369 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:57.900182 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:38:59.186074 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:00.039560 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 4405797 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:02.297516 [ 3993 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:02.297681 [ 3154 ] {a4e07ea1-24fb-47c3-87b2-5e92adc8f1fe} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:33948) (comment: 02317_distinct_in_order_optimization_explain.sh) (in query: set allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:04.593007 [ 19212 ] {} <Error> ExternalDictionariesLoader: Could not update external dictionary '81e60cff-6435-46d5-a273-0228ad10ee5e', leaving the previous version, next update is scheduled at 2024-09-24 02:39:03: Code: 60. DB::Exception: Table test_13.dictionary_decimal_source_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:171: DB::ClickHouseDictionarySource::createStreamForQuery(String const&) @ 0x000000002b0af62b in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:113: DB::ClickHouseDictionarySource::loadAll() @ 0x000000002b0af3b5 in /usr/bin/clickhouse
17. DB::FlatDictionary::loadData() @ 0x000000002b2d750b in /usr/bin/clickhouse
18. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
19. std::shared_ptr<DB::FlatDictionary> std::allocate_shared[abi:v15000]<DB::FlatDictionary, std::allocator<DB::FlatDictionary>, DB::StorageID, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&, void>(std::allocator<DB::FlatDictionary> const&, DB::StorageID&&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>&&, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&) @ 0x000000002b356569 in /usr/bin/clickhouse
20. DB::FlatDictionary::clone() const @ 0x000000002b33fd64 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc12ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:04.593027 [ 4381 ] {f0498671-9a27-4e5d-a3e6-07c6eba0b546} <Error> TCPHandler: Code: 253. DB::Exception: Replica /clickhouse/tables/db_01530_atomic/db_01530_atomic/data/replicas/test already exists. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::createReplica(std::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x000000003bf7edb2 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:538: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool) @ 0x000000003bf4c82c in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageReplicatedMergeTree> std::allocate_shared[abi:v15000]<DB::StorageReplicatedMergeTree, std::allocator<DB::StorageReplicatedMergeTree>, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator<DB::StorageReplicatedMergeTree> const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x000000003da14334 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da076e2 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:04.593318 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:04.593424 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_80_84_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1233727 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:04.593628 [ 2396 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:04.593756 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 4409678 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:04.593815 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 5211356 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:04.593852 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:04.593416 [ 3983 ] {23449319-ca86-4b9f-80b6-c5a886e7f971} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 WHERE d1 = 0 SETTINGS force_data_skipping_indices='d1_null_idx,d1_idx';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:04.594043 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1185823 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:05.344658 [ 2529 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:05.846583 [ 6603 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:05.847098 [ 3980 ] {c16cdb03-ad58-426e-85ff-5d6d51af630c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56648) (comment: 00226_zookeeper_deduplication_and_unexpected_parts_long.sql) (in query: INSERT INTO deduplication (x) VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000003d959631 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse

2024.09.24 02:39:05.847141 [ 3154 ] {a4e07ea1-24fb-47c3-87b2-5e92adc8f1fe} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:05.847252 [ 3976 ] {e994f33e-04a3-4d0b-b436-c8a523833de9} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50242) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:07.241520 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:07.241527 [ 6598 ] {4cf1d26e-93c8-404a-9672-0a46a501079a} <Error> executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59692) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910 ADD COLUMN j2 Tuple(Float64, JSON);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [114]>(int, char const (&) [114]) @ 0x0000000036ad3f77 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92ebd0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:07.241547 [ 3239 ] {a7d3cf06-6eb9-4fb9-b615-cad9bd03337c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1289068 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50276) (comment: 00151_order_by_read_in_order.sql) (in query: SELECT EventDate FROM test.hits ORDER BY CounterID, EventDate DESC LIMIT 50;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse

2024.09.24 02:39:08.163858 [ 2759 ] {1c7b8868-fce6-448b-9c54-d240ab2cac6c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1049191 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50280) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:39:08.547534 [ 2537 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp426c5419-94cd-4991-b600-34abc0c427d2' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:39:10.709116 [ 3982 ] {66c2ef80-8a17-465e-9a72-dcbe440fd1f2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1056640 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59716) (comment: 00040_aggregating_materialized_view.sql) (in query: CREATE MATERIALIZED VIEW test.basic_00040 ENGINE = AggregatingMergeTree(StartDate, (CounterID, StartDate), 8192) POPULATE AS SELECT CounterID, StartDate, sumState(Sign) AS Visits, uniqState(UserID) AS Users FROM test.visits GROUP BY CounterID, StartDate;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:164: DB::pushBackAndCreateState(DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::Arena&, DB::IAggregateFunction const*) @ 0x000000003ac89f83 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnAggregateFunction.cpp:525: DB::ColumnAggregateFunction::insertDefault() @ 0x000000003ac8852a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::AggregatingSortedAlgorithm::AggregatingMergedData::startGroup(std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, unsigned long) @ 0x000000003ee8c175 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/AggregatingSortedAlgorithm.cpp:0: DB::AggregatingSortedAlgorithm::merge() @ 0x000000003ee9400c in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:367: DB::MergeTreeDataWriter::mergeBlock(DB::Block const&, DB::SortDescription, std::vector<String, std::allocator<String>> const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>*&, DB::MergeTreeData::MergingParams const&) @ 0x000000003d640bc0 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d644c40 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:13.011935 [ 3186 ] {edfc6f8b-364d-4459-980b-d6c2f13c7439} <Error> executeQuery: Code: 636. DB::Exception: Cannot extract table structure from ORC format file. Error: std::exception. Code: 1001, type: orc::ParseError, e.what() = Footer is corrupt: STRUCT type 0 has 3 subTypes, but has 2 fieldNames (version 23.8.16.41.altinitystable (altinity build)). You can specify the structure manually: (in file/uri /var/lib/clickhouse/user_files/corrupted.orc). (CANNOT_EXTRACT_TABLE_STRUCTURE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:33964) (comment: 02185_orc_corrupted_file.sh) (in query: select * from file('corrupted.orc')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, String&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String&>::type>, String const&, String&) @ 0x0000000020afe455 in /usr/bin/clickhouse
3. ./build_docker/./src/Formats/ReadSchemaUtils.cpp:169: DB::readSchemaFromFormat(String const&, std::optional<DB::FormatSettings> const&, DB::IReadBufferIterator&, bool, std::shared_ptr<DB::Context const>&, std::unique_ptr<DB::ReadBuffer, std::default_delete<DB::ReadBuffer>>&) @ 0x000000003e180dac in /usr/bin/clickhouse
4. ./build_docker/./src/Formats/ReadSchemaUtils.cpp:0: DB::readSchemaFromFormat(String const&, std::optional<DB::FormatSettings> const&, DB::IReadBufferIterator&, bool, std::shared_ptr<DB::Context const>&) @ 0x000000003e182017 in /usr/bin/clickhouse
5. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::StorageFile::getTableStructureFromFile(String const&, std::vector<String, std::allocator<String>> const&, String const&, std::optional<DB::FormatSettings> const&, std::shared_ptr<DB::Context const>, std::optional<DB::StorageFile::ArchiveInfo> const&) @ 0x000000003bc20739 in /usr/bin/clickhouse
6. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::StorageFile::setStorageMetadata(DB::StorageFile::CommonArguments) @ 0x000000003bc2e35f in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageFile.cpp:0: DB::StorageFile::StorageFile(String const&, String const&, DB::StorageFile::CommonArguments) @ 0x000000003bc30a46 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr<DB::StorageFile> std::allocate_shared[abi:v15000]<DB::StorageFile, std::allocator<DB::StorageFile>, String const&, String, DB::StorageFile::CommonArguments&, void>(std::allocator<DB::StorageFile> const&, String const&, String&&, DB::StorageFile::CommonArguments&) @ 0x0000000034a3bb9a in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TableFunctionFile::getStorage(String const&, String const&, DB::ColumnsDescription const&, std::shared_ptr<DB::Context const>, String const&, String const&) const @ 0x0000000034a352e4 in /usr/bin/clickhouse
10. ./build_docker/./src/TableFunctions/ITableFunctionFileLike.cpp:121: DB::ITableFunctionFileLike::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x0000000034a416e8 in /usr/bin/clickhouse
11. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:13.011983 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 5137185 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:13.012011 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 5127137 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:13.012170 [ 3983 ] {23449319-ca86-4b9f-80b6-c5a886e7f971} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:13.012321 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_78_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1069135 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.066276 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4196157 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.066317 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4236286 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.066365 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4532482 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.066766 [ 2349 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.066860 [ 2529 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.066879 [ 17778 ] {} <Error> ExternalDictionariesLoader: Could not update external dictionary '81e60cff-6435-46d5-a273-0228ad10ee5e', leaving the previous version, next update is scheduled at 2024-09-24 02:39:11: Code: 60. DB::Exception: Table test_13.dictionary_decimal_source_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:171: DB::ClickHouseDictionarySource::createStreamForQuery(String const&) @ 0x000000002b0af62b in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:113: DB::ClickHouseDictionarySource::loadAll() @ 0x000000002b0af3b5 in /usr/bin/clickhouse
17. DB::FlatDictionary::loadData() @ 0x000000002b2d750b in /usr/bin/clickhouse
18. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
19. std::shared_ptr<DB::FlatDictionary> std::allocate_shared[abi:v15000]<DB::FlatDictionary, std::allocator<DB::FlatDictionary>, DB::StorageID, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&, void>(std::allocator<DB::FlatDictionary> const&, DB::StorageID&&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>&&, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&) @ 0x000000002b356569 in /usr/bin/clickhouse
20. DB::FlatDictionary::clone() const @ 0x000000002b33fd64 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc12ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.066922 [ 2751 ] {b8445ed3-350f-46af-a2ff-9f947e320872} <Error> executeQuery: Code: 676. DB::ParsingException: Cannot parse IPv6 .1.2.3: Cannot parse IPv6 from String: While processing toIPv6('::.1.2.3'). (CANNOT_PARSE_IPV6) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42124) (comment: 02234_cast_to_ip_address.sql) (in query: SELECT toIPv6('::.1.2.3');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::ParsingException::ParsingException<std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000009e613bb in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ConvertThroughParsing<DB::DataTypeString, DB::DataTypeIPv6, DB::NameToIPv6, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, void*) @ 0x0000000009f1f389 in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<DB::DataTypeIPv6, DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009ee17f5 in /usr/bin/clickhouse
5. DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009ed49b3 in /usr/bin/clickhouse
6. DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009ed31e2 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:39:17.066971 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.067057 [ 2432 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.067149 [ 6600 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.067357 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.067323 [ 3980 ] {c16cdb03-ad58-426e-85ff-5d6d51af630c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000003d959631 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse

2024.09.24 02:39:17.067493 [ 3239 ] {a7d3cf06-6eb9-4fb9-b615-cad9bd03337c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1289068 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse

2024.09.24 02:39:17.067558 [ 6598 ] {4cf1d26e-93c8-404a-9672-0a46a501079a} <Error> TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [114]>(int, char const (&) [114]) @ 0x0000000036ad3f77 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92ebd0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:17.067696 [ 2860 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.067898 [ 3982 ] {66c2ef80-8a17-465e-9a72-dcbe440fd1f2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1056640 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:164: DB::pushBackAndCreateState(DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::Arena&, DB::IAggregateFunction const*) @ 0x000000003ac89f83 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnAggregateFunction.cpp:525: DB::ColumnAggregateFunction::insertDefault() @ 0x000000003ac8852a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::AggregatingSortedAlgorithm::AggregatingMergedData::startGroup(std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, unsigned long) @ 0x000000003ee8c175 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/AggregatingSortedAlgorithm.cpp:0: DB::AggregatingSortedAlgorithm::merge() @ 0x000000003ee9400c in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:367: DB::MergeTreeDataWriter::mergeBlock(DB::Block const&, DB::SortDescription, std::vector<String, std::allocator<String>> const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>*&, DB::MergeTreeData::MergingParams const&) @ 0x000000003d640bc0 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d644c40 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:17.067905 [ 2759 ] {1c7b8868-fce6-448b-9c54-d240ab2cac6c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1049191 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:39:17.068006 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4309358 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.067716 [ 3976 ] {e994f33e-04a3-4d0b-b436-c8a523833de9} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:17.068159 [ 3186 ] {edfc6f8b-364d-4459-980b-d6c2f13c7439} <Error> TCPHandler: Code: 636. DB::Exception: Cannot extract table structure from ORC format file. Error: std::exception. Code: 1001, type: orc::ParseError, e.what() = Footer is corrupt: STRUCT type 0 has 3 subTypes, but has 2 fieldNames (version 23.8.16.41.altinitystable (altinity build)). You can specify the structure manually: (in file/uri /var/lib/clickhouse/user_files/corrupted.orc). (CANNOT_EXTRACT_TABLE_STRUCTURE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, String&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String&>::type>, String const&, String&) @ 0x0000000020afe455 in /usr/bin/clickhouse
3. ./build_docker/./src/Formats/ReadSchemaUtils.cpp:169: DB::readSchemaFromFormat(String const&, std::optional<DB::FormatSettings> const&, DB::IReadBufferIterator&, bool, std::shared_ptr<DB::Context const>&, std::unique_ptr<DB::ReadBuffer, std::default_delete<DB::ReadBuffer>>&) @ 0x000000003e180dac in /usr/bin/clickhouse
4. ./build_docker/./src/Formats/ReadSchemaUtils.cpp:0: DB::readSchemaFromFormat(String const&, std::optional<DB::FormatSettings> const&, DB::IReadBufferIterator&, bool, std::shared_ptr<DB::Context const>&) @ 0x000000003e182017 in /usr/bin/clickhouse
5. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::StorageFile::getTableStructureFromFile(String const&, std::vector<String, std::allocator<String>> const&, String const&, std::optional<DB::FormatSettings> const&, std::shared_ptr<DB::Context const>, std::optional<DB::StorageFile::ArchiveInfo> const&) @ 0x000000003bc20739 in /usr/bin/clickhouse
6. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::StorageFile::setStorageMetadata(DB::StorageFile::CommonArguments) @ 0x000000003bc2e35f in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/StorageFile.cpp:0: DB::StorageFile::StorageFile(String const&, String const&, DB::StorageFile::CommonArguments) @ 0x000000003bc30a46 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr<DB::StorageFile> std::allocate_shared[abi:v15000]<DB::StorageFile, std::allocator<DB::StorageFile>, String const&, String, DB::StorageFile::CommonArguments&, void>(std::allocator<DB::StorageFile> const&, String const&, String&&, DB::StorageFile::CommonArguments&) @ 0x0000000034a3bb9a in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TableFunctionFile::getStorage(String const&, String const&, DB::ColumnsDescription const&, std::shared_ptr<DB::Context const>, String const&, String const&) const @ 0x0000000034a352e4 in /usr/bin/clickhouse
10. ./build_docker/./src/TableFunctions/ITableFunctionFileLike.cpp:121: DB::ITableFunctionFileLike::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x0000000034a416e8 in /usr/bin/clickhouse
11. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:17.909627 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 5007084 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.909689 [ 2118 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.909737 [ 3232 ] {f02e40e2-1bcc-4143-8137-372fa7b5df7e} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1507328 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:33978) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:17.909882 [ 2751 ] {b8445ed3-350f-46af-a2ff-9f947e320872} <Error> TCPHandler: Code: 676. DB::ParsingException: Cannot parse IPv6 .1.2.3: Cannot parse IPv6 from String: While processing toIPv6('::.1.2.3'). (CANNOT_PARSE_IPV6), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::ParsingException::ParsingException<std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000009e613bb in /usr/bin/clickhouse
3. COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ConvertThroughParsing<DB::DataTypeString, DB::DataTypeIPv6, DB::NameToIPv6, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute<void*>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, void*) @ 0x0000000009f1f389 in /usr/bin/clickhouse
4. bool DB::callOnIndexAndDataType<DB::DataTypeIPv6, DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009ee17f5 in /usr/bin/clickhouse
5. DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009ed49b3 in /usr/bin/clickhouse
6. DB::FunctionConvert<DB::DataTypeIPv6, DB::NameToIPv6, DB::ToNumberMonotonicity<wide::integer<128ul, unsigned int>>>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009ed31e2 in /usr/bin/clickhouse
7. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse

2024.09.24 02:39:17.910045 [ 3989 ] {e1a43668-426a-4f75-9a3f-8c468cd5badf} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40874) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSVWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:17.910290 [ 3182 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.910342 [ 18040 ] {} <Error> ExternalDictionariesLoader: Could not update external dictionary '81e60cff-6435-46d5-a273-0228ad10ee5e', leaving the previous version, next update is scheduled at 2024-09-24 02:39:22: Code: 60. DB::Exception: Table test_13.dictionary_decimal_source_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:171: DB::ClickHouseDictionarySource::createStreamForQuery(String const&) @ 0x000000002b0af62b in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:113: DB::ClickHouseDictionarySource::loadAll() @ 0x000000002b0af3b5 in /usr/bin/clickhouse
17. DB::FlatDictionary::loadData() @ 0x000000002b2d750b in /usr/bin/clickhouse
18. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
19. std::shared_ptr<DB::FlatDictionary> std::allocate_shared[abi:v15000]<DB::FlatDictionary, std::allocator<DB::FlatDictionary>, DB::StorageID, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&, void>(std::allocator<DB::FlatDictionary> const&, DB::StorageID&&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>&&, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&) @ 0x000000002b356569 in /usr/bin/clickhouse
20. DB::FlatDictionary::clone() const @ 0x000000002b33fd64 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc12ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.910342 [ 6598 ] {1f64f87e-7419-4784-86f6-224a356720fc} <Error> executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59692) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910 ADD COLUMN j2 Tuple(Array(Tuple(JSON))) DEFAULT jString;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [114]>(int, char const (&) [114]) @ 0x0000000036ad3f77 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92ebd0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:17.910366 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_78_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1069135 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.910471 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5137185 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:17.910606 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_80_84_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1233727 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:18.162220 [ 2404 ] {} <Warning> test_4ur2nbw4.deduplication (1c545cfb-68a5-49b2-972c-26c316553659): Node with parent zookeeper lock /clickhouse/zero_copy/zero_copy_s3/1c545cfb-68a5-49b2-972c-26c316553659/201501_0_0_0/test_axn_qbfunkobtozwuevqurqnxqjkipqjt for part 201501_0_0_0 doesn't exist (part was unlocked before), refuse to remove blobs
2024.09.24 02:39:19.000455 [ 3990 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.000507 [ 6598 ] {1f64f87e-7419-4784-86f6-224a356720fc} <Error> TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [114]>(int, char const (&) [114]) @ 0x0000000036ad3f77 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92ebd0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.000552 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.000652 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1185823 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.000724 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.000733 [ 6600 ] {4d927e9d-3633-4996-ae41-205221f6e566} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35438) (comment: 02317_distinct_in_order_optimization_explain.sh) (in query: set allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.000843 [ 3987 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.000805 [ 3983 ] {089b4132-4350-4dba-8572-559f32bc6b7d} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 WHERE d1 = 0 SETTINGS force_data_skipping_indices='d1_null_idx,d1_idx,,';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.000814 [ 2396 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.002767 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4227838 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:167: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000003700474d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.002978 [ 6601 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.013720 [ 3139 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.013880 [ 3983 ] {089b4132-4350-4dba-8572-559f32bc6b7d} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.019267 [ 6600 ] {4d927e9d-3633-4996-ae41-205221f6e566} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.022753 [ 3994 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.023613 [ 2950 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.025664 [ 2782 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.026643 [ 2905 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.034933 [ 3101 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.037188 [ 3992 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.038737 [ 3991 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.042885 [ 2939 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.051823 [ 4381 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.055230 [ 6598 ] {de0af3c8-a130-4fd8-867a-add2f6332f9e} <Error> executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59692) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910 ADD COLUMN j2 JSON default jString;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [114]>(int, char const (&) [114]) @ 0x0000000036ad3f77 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92ebd0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.058801 [ 6603 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.067040 [ 21628 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.075881 [ 6598 ] {de0af3c8-a130-4fd8-867a-add2f6332f9e} <Error> TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [114]>(int, char const (&) [114]) @ 0x0000000036ad3f77 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92ebd0 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.086381 [ 21629 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.092519 [ 3239 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.096986 [ 3982 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.100031 [ 3186 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:19.156392 [ 6598 ] {bae728fd-3642-4f84-880f-cc7fc9f834b0} <Warning> test_3l9dcvx2.test02910_second (72ca2ead-8b88-49a4-9529-9901f603eff5): Table can't create parts with adaptive granularity, but settings min_rows_for_wide_part = 0, min_bytes_for_wide_part = 173090848. Parts with non-adaptive granularity can be stored only in Wide (default) format. Settings 'min_rows_for_wide_part'and 'min_bytes_for_wide_part' will be ignored.
2024.09.24 02:39:19.209669 [ 3983 ] {7621d7ff-898f-4d3c-8b1d-a579352d82bd} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 WHERE d1 = 0 SETTINGS force_data_skipping_indices='  d1_null_idx,d1_idx';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.227194 [ 3983 ] {7621d7ff-898f-4d3c-8b1d-a579352d82bd} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.355479 [ 3983 ] {7a24207c-46f2-4386-9e55-98c42f95d75c} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 WHERE d1 = 0 SETTINGS force_data_skipping_indices='  `d1_null_idx`,d1_idx';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.370292 [ 3983 ] {7a24207c-46f2-4386-9e55-98c42f95d75c} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.859325 [ 6601 ] {7b46d94f-25f3-4b11-b2fc-459e741cd147} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35488) (comment: 02317_distinct_in_order_optimization_explain.sh) (in query: set allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.879777 [ 6601 ] {7b46d94f-25f3-4b11-b2fc-459e741cd147} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.899959 [ 3983 ] {0d83442b-15e7-43ab-a8ba-ccc8645929b4} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 WHERE d1 = 0 SETTINGS force_data_skipping_indices='d1_null_idx';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:19.907351 [ 3983 ] {0d83442b-15e7-43ab-a8ba-ccc8645929b4} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:20.026868 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:20.027996 [ 2394 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:20.141761 [ 3983 ] {9d2c4f7d-ed61-4ec3-b11a-ce5b0acd416b} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 WHERE d1 = 0 SETTINGS force_data_skipping_indices='  d1_null_idx  ';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:20.152646 [ 3983 ] {9d2c4f7d-ed61-4ec3-b11a-ce5b0acd416b} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:20.491484 [ 3983 ] {aaa6eeb1-6bfd-4433-befa-d8fa176bebe7} <Error> executeQuery: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57078) (comment: 01515_force_data_skipping_indices.sql) (in query: SELECT * FROM data_01515 WHERE d1_null = 0 SETTINGS force_data_skipping_indices='d1_null_idx';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:20.500747 [ 3983 ] {aaa6eeb1-6bfd-4433-befa-d8fa176bebe7} <Error> TCPHandler: Code: 277. DB::Exception: Index `d1_null_idx` is not used and setting 'force_data_skipping_indices' contains it. (INDEX_NOT_USED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:929: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, Poco::Logger*, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000003d1eaa46 in /usr/bin/clickhouse
4. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1498: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1df644 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::PrewhereInfo> const&, DB::ActionDAGNodes const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, bool, Poco::Logger*, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000003f1d2b90 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:0: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000003f1d1b85 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1682: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000003f1eb9c8 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/QueryPlan/ReadFromMergeTree.cpp:1791: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f1f284f in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000003f110063 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000003f16a911 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e73b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:20.612060 [ 3989 ] {e1a43668-426a-4f75-9a3f-8c468cd5badf} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:20.767506 [ 3232 ] {f02e40e2-1bcc-4143-8137-372fa7b5df7e} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1507328 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:21.036621 [ 2406 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:21.039419 [ 2462 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:22.052954 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:22.052275 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:22.836061 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.66 GiB (attempt to allocate chunk of 4456511 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:29.201144 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.68 GiB (attempt to allocate chunk of 4284567 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:32.384770 [ 2939 ] {} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000035e1bd4e in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1904: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x00000000378b8175 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x000000003e0df937 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x000000003e0bf4be in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:33.655434 [ 2346 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:33.655452 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.70 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:33.655448 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.70 GiB (attempt to allocate chunk of 4399470 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:33.655466 [ 3992 ] {13700b9e-7fa3-4a61-8286-6236f6540144} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.67 GiB (attempt to allocate chunk of 1048608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column GeneralInterests): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 24 with max_rows_to_read = 49152): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35512) (comment: 00086_array_reduce.sql) (in query: SELECT arrayFilter(x -> x != 1, arrayMap((a, b) -> a = b, GeneralInterests, arrayReduce('groupArray', GeneralInterests))) AS res FROM test.hits WHERE length(res) != 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a984e in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned short>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f99490 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse

2024.09.24 02:39:33.655656 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.70 GiB (attempt to allocate chunk of 4198398 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:33.655482 [ 2419 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:33.659931 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4 (to which part must be renamed before removing) already exists. Most likely this is due to unclean restart or race condition. Removing it.
2024.09.24 02:39:35.584630 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.70 GiB (attempt to allocate chunk of 4235711 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:35.584917 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.70 GiB (attempt to allocate chunk of 4998844 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:35.584956 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.67 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:37.171367 [ 2782 ] {004ff826-1e16-4de2-9dde-fa31f7ee881b} <Error> executeQuery: Code: 42. DB::Exception: Function arrayPartialSort needs at least 2 arguments, passed 1: While processing arrayPartialSort([1, 2, 3]). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35528) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialSort([1,2,3]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, unsigned long&, char const*, unsigned long>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<char const*>::type, std::type_identity<unsigned long>::type>, String&&, unsigned long&, char const*&&, unsigned long&&) @ 0x000000001db0e147 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db7755f in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:39:37.171401 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.70 GiB (attempt to allocate chunk of 4228094 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:167: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000003700474d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:37.171503 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.70 GiB (attempt to allocate chunk of 4228066 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:37.171630 [ 18550 ] {} <Error> ExternalDictionariesLoader: Could not update external dictionary '81e60cff-6435-46d5-a273-0228ad10ee5e', leaving the previous version, next update is scheduled at 2024-09-24 02:39:38: Code: 60. DB::Exception: Table test_13.dictionary_decimal_source_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:171: DB::ClickHouseDictionarySource::createStreamForQuery(String const&) @ 0x000000002b0af62b in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:113: DB::ClickHouseDictionarySource::loadAll() @ 0x000000002b0af3b5 in /usr/bin/clickhouse
17. DB::FlatDictionary::loadData() @ 0x000000002b2d750b in /usr/bin/clickhouse
18. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
19. std::shared_ptr<DB::FlatDictionary> std::allocate_shared[abi:v15000]<DB::FlatDictionary, std::allocator<DB::FlatDictionary>, DB::StorageID, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&, void>(std::allocator<DB::FlatDictionary> const&, DB::StorageID&&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>&&, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&) @ 0x000000002b356569 in /usr/bin/clickhouse
20. DB::FlatDictionary::clone() const @ 0x000000002b33fd64 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc12ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:38.718032 [ 6601 ] {mysql:2:ee9e8cb4-83a8-4188-8ea6-8e6b46f2dd37} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1052799 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55940) (in query: INSERT INTO b VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse

2024.09.24 02:39:38.718086 [ 3994 ] {26fd4439-578c-41e5-92ae-37ac6a5ebca5} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35550) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:39:38.932232 [ 2558 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Removing temporary directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:39:38.932344 [ 2558 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:39:40.638421 [ 2751 ] {d5f6c236-00a8-451b-8d8c-83ecd905b5e7} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42124) (comment: 02234_cast_to_ip_address.sql) (in query: SELECT count() FROM numbers_mt(100000000) WHERE NOT ignore(toIPv6OrZero(randomString(8)));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:40.638431 [ 6598 ] {4b29f5f8-4613-476b-8da0-c571395bcf02} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1145170 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59692) (comment: 02910_object-json-crash-add-column.sql) (in query: INSERT INTO test02910_second SELECT number, number, '2023-10-28 11:11:11.11111', [] FROM numbers(10);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:243: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669f95 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse

2024.09.24 02:39:40.638525 [ 4381 ] {2cc51830-cbed-44f3-b9e1-32a06a653ee1} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1081407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35540) (comment: 02456_bloom_filter_assert.gen.sql) (in query: INSERT INTO bftest__fuzz_21 (k, x) SELECT number, arrayMap(i -> (rand64() % 565656), range(10)) FROM numbers(1000);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse

2024.09.24 02:39:40.638998 [ 2118 ] {ab004e60-743f-41c5-95cd-58a76b1b1549} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1056736 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35464) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:41.624821 [ 3232 ] {a1095ee2-9c88-4318-8b21-2e1fb539f420} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35524) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSVWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:41.624821 [ 3139 ] {9ae0cad1-0d48-4d9e-9e98-788e9a479d92} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1149592 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35526) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:39:41.625004 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.68 GiB (attempt to allocate chunk of 1052038 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435e51 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:322: DB::ColumnVector<long>::insertDefault() @ 0x000000003b354a15 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::ColumnSparse(COW<DB::IColumn>::mutable_ptr<DB::IColumn>&&) @ 0x000000003b1a1813 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::IDataType::createColumn(DB::ISerialization const&) const @ 0x0000000036dd5efa in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:140: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d473eda in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:41.625152 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_78_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.67 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:41.625294 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.68 GiB (attempt to allocate chunk of 1050593 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435e51 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd78e in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:43.952065 [ 3992 ] {13700b9e-7fa3-4a61-8286-6236f6540144} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.67 GiB (attempt to allocate chunk of 1048608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column GeneralInterests): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 24 with max_rows_to_read = 49152): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a984e in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned short>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f99490 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse

2024.09.24 02:39:43.952055 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:43.952397 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:43.952525 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:43.952625 [ 2751 ] {d5f6c236-00a8-451b-8d8c-83ecd905b5e7} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:43.952650 [ 4381 ] {2cc51830-cbed-44f3-b9e1-32a06a653ee1} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1081407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse

2024.09.24 02:39:43.952761 [ 3139 ] {9ae0cad1-0d48-4d9e-9e98-788e9a479d92} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1149592 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:39:43.952567 [ 3994 ] {26fd4439-578c-41e5-92ae-37ac6a5ebca5} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:39:43.952572 [ 6598 ] {4b29f5f8-4613-476b-8da0-c571395bcf02} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1145170 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:243: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669f95 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse

2024.09.24 02:39:43.952705 [ 2118 ] {ab004e60-743f-41c5-95cd-58a76b1b1549} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1056736 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:43.952947 [ 6601 ] {} <Error> MySQLHandler: MySQLHandler: Cannot read packet: : Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1052799 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:43.953081 [ 17742 ] {} <Error> ExternalDictionariesLoader: Could not update external dictionary '81e60cff-6435-46d5-a273-0228ad10ee5e', leaving the previous version, next update is scheduled at 2024-09-24 02:40:00: Code: 60. DB::Exception: Table test_13.dictionary_decimal_source_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:171: DB::ClickHouseDictionarySource::createStreamForQuery(String const&) @ 0x000000002b0af62b in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:113: DB::ClickHouseDictionarySource::loadAll() @ 0x000000002b0af3b5 in /usr/bin/clickhouse
17. DB::FlatDictionary::loadData() @ 0x000000002b2d750b in /usr/bin/clickhouse
18. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
19. std::shared_ptr<DB::FlatDictionary> std::allocate_shared[abi:v15000]<DB::FlatDictionary, std::allocator<DB::FlatDictionary>, DB::StorageID, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&, void>(std::allocator<DB::FlatDictionary> const&, DB::StorageID&&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>&&, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&) @ 0x000000002b356569 in /usr/bin/clickhouse
20. DB::FlatDictionary::clone() const @ 0x000000002b33fd64 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc12ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:43.952797 [ 3232 ] {a1095ee2-9c88-4318-8b21-2e1fb539f420} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:43.953063 [ 2950 ] {a1a33cf4-b0d6-493d-8ae8-d6e44333f792} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44976) (comment: 02342_analyzer_compound_types.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:43.954961 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Cannot recursively remove directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4. Exception: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While committing metadata operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:43.955641 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> void DB::IMergeTreeDataPart::removeIfNeeded(): while removing part all_1_1_1_4 with path store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While committing metadata operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:43.958101 [ 2950 ] {a1a33cf4-b0d6-493d-8ae8-d6e44333f792} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:43.952496 [ 2782 ] {004ff826-1e16-4de2-9dde-fa31f7ee881b} <Error> TCPHandler: Code: 42. DB::Exception: Function arrayPartialSort needs at least 2 arguments, passed 1: While processing arrayPartialSort([1, 2, 3]). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, unsigned long&, char const*, unsigned long>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<char const*>::type, std::type_identity<unsigned long>::type>, String&&, unsigned long&, char const*&&, unsigned long&&) @ 0x000000001db0e147 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db7755f in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:39:43.983186 [ 2532 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.66 GiB (attempt to allocate chunk of 4456511 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:56: DB::MergedColumnOnlyOutputStream::write(DB::Block const&) @ 0x000000003d679929 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::PartMergerWriter::mutateOriginalPartAndPrepareProjections() @ 0x000000003d69a079 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:0: DB::MutateSomePartColumnsTask::executeStep() @ 0x000000003d6fc7f4 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x000000003d69f9b2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad5f1d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:45.819570 [ 3994 ] {6f2e03cf-7303-4855-8d5e-fd03d12c1751} <Error> executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53396) (comment: 00202_cross_join.sql) (in query: SELECT x, y FROM (SELECT number AS x FROM system.numbers LIMIT 3) js1 CROSS JOIN (SELECT number AS y FROM system.numbers LIMIT 5) js2;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:45.820063 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:45.827485 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:45.828107 [ 2782 ] {c1843c97-074f-44dc-8065-8746768a1dc9} <Error> executeQuery: Code: 43. DB::Exception: First argument for function arrayPartialSort must be a function. Actual UInt8: While processing arrayPartialSort(2, [1, 2, 3], [1]). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35528) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialSort(2, [1,2,3], [1]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db77a6e in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:39:46.270296 [ 3994 ] {6f2e03cf-7303-4855-8d5e-fd03d12c1751} <Error> TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:46.270296 [ 2782 ] {c1843c97-074f-44dc-8065-8746768a1dc9} <Error> TCPHandler: Code: 43. DB::Exception: First argument for function arrayPartialSort must be a function. Actual UInt8: While processing arrayPartialSort(2, [1, 2, 3], [1]). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db77a6e in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:39:46.279576 [ 2382 ] {} <Error> DatabaseCatalog: Failed to remove unused directory store/ddd/ddd87d6f-6984-4be0-9a5b-c7baa4602ece/ from disk default (/var/lib/clickhouse/): Code: 400. DB::ErrnoException: Cannot stat file: store/ddd/ddd87d6f-6984-4be0-9a5b-c7baa4602ece/, errno: 2, strerror: No such file or directory. (CANNOT_STAT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::stat(String const&) const @ 0x00000000372605fb in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:1510: DB::DatabaseCatalog::maybeRemoveDirectory(String const&, std::shared_ptr<DB::IDisk> const&, String const&) @ 0x0000000037b07722 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::cleanupStoreDirectoryTask() @ 0x0000000037b03a87 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::DatabaseCatalog::createBackgroundTasks()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x0000000037b0cc5f in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
10. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:46.404253 [ 2542 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 6496): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:47.333199 [ 2542 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4 (to which part must be renamed before removing) already exists. Most likely this is due to unclean restart or race condition. Removing it.
2024.09.24 02:39:49.526533 [ 2559 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Removing temporary directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:39:49.526967 [ 2559 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:39:50.096513 [ 2782 ] {ac88fd17-57f4-46e2-bbc4-54c0ec1ca575} <Error> executeQuery: Code: 43. DB::Exception: First argument for function arrayPartialSort must be a function. Actual UInt8: While processing arrayPartialSort(2, [1, 2, 3], 3). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35528) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialSort(2, [1,2,3], 3);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db77a6e in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:39:52.529255 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4194556 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66cdfe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:54.148971 [ 2562 ] {} <Warning> system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70): Removing temporary directory /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_78_19/
2024.09.24 02:39:54.149096 [ 2562 ] {} <Warning> system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_78_19/
2024.09.24 02:39:54.512833 [ 2585 ] {} <Error> void DB::SystemLog<DB::SessionLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4209938 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:269: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66b425 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::SessionLogElement>::flushImpl(std::vector<DB::SessionLogElement, std::allocator<DB::SessionLogElement>> const&, unsigned long) @ 0x000000003a466b33 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:54.513349 [ 6601 ] {73aa1c86-65f1-42f2-9ca8-5bd83f19a7cc} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1149592 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53394) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:39:58.121016 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:58.121092 [ 2542 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:58.121187 [ 2389 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:58.121238 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5080437 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:58.121074 [ 3154 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:58.121440 [ 2782 ] {ac88fd17-57f4-46e2-bbc4-54c0ec1ca575} <Error> TCPHandler: Code: 43. DB::Exception: First argument for function arrayPartialSort must be a function. Actual UInt8: While processing arrayPartialSort(2, [1, 2, 3], 3). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db77a6e in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:39:58.121749 [ 2905 ] {79d3d1ce-e95b-40ab-940f-8453232ccb67} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1114112 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53414) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSKV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:58.121791 [ 2950 ] {cc7a54d7-971f-4a8e-9250-8c847a83202c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53400) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:39:58.122249 [ 2542 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Cannot recursively remove directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4. Exception: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:58.123231 [ 2567 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:39:58.123338 [ 2567 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:39:58.756672 [ 6601 ] {73aa1c86-65f1-42f2-9ca8-5bd83f19a7cc} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1149592 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:39:58.756782 [ 3990 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:39:58.757162 [ 3239 ] {8184f864-7ec5-438b-9459-d4d8da755fd8} <Error> executeQuery: Code: 42. DB::Exception: Table name was not found in function arguments. Table function 'remote' requires from 1 to 6 parameters: <addresses pattern> [, <name of remote database>, <name of remote table>] [, username[, password], sharding_key]. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: select * from remote('127.0.0.1', sys);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const>(int, FormatStringHelperImpl<std::type_identity<String const>::type>, String const&&) @ 0x00000000349ef775 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:178: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7faa in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:00.641018 [ 2562 ] {} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_78_19/, errno: 2, strerror: No such file or directory. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:00.641083 [ 2542 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> void DB::IMergeTreeDataPart::removeIfNeeded(): while removing part all_1_1_1_4 with path store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x00000000373001e3 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:341: DB::UnlinkMetadataFileOperation::undo() @ 0x0000000037303daf in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x00000000372e4e1d in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4d20 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:00.641304 [ 2905 ] {79d3d1ce-e95b-40ab-940f-8453232ccb67} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1114112 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:00.641355 [ 2950 ] {cc7a54d7-971f-4a8e-9250-8c847a83202c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:00.641450 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 8609855 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:00.641522 [ 2759 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:00.641574 [ 3239 ] {8184f864-7ec5-438b-9459-d4d8da755fd8} <Error> TCPHandler: Code: 42. DB::Exception: Table name was not found in function arguments. Table function 'remote' requires from 1 to 6 parameters: <addresses pattern> [, <name of remote database>, <name of remote table>] [, username[, password], sharding_key]. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const>(int, FormatStringHelperImpl<std::type_identity<String const>::type>, String const&&) @ 0x00000000349ef775 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:178: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7faa in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:01.224726 [ 2561 ] {} <Warning> system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70): Removing temporary directory /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_78_19/
2024.09.24 02:40:01.224812 [ 2561 ] {} <Warning> system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_78_19/
2024.09.24 02:40:02.179468 [ 2407 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:02.179573 [ 2562 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::lambda}: Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_78_19/, errno: 2, strerror: No such file or directory: While committing metadata operation #0. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:02.179585 [ 2347 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:02.179626 [ 3987 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:02.179513 [ 2782 ] {96d9a0ea-bd60-4178-beb0-f3411d9357ea} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Array(UInt8) of limit argument of function arrayPartialSort (must be UInt or Int): While processing arrayPartialSort(arraySort([1, 2, 3]), [1, 2, 3]). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35528) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialSort(arraySort([1,2,3]), [1,2,3]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<true, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db7b8d4 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db76359 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:40:02.334400 [ 2540 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmpfe62c5d4-9873-4c31-a715-c2edd7a436eb' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:40:04.541123 [ 2567 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Removing temporary directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/
2024.09.24 02:40:04.541239 [ 2567 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/
2024.09.24 02:40:04.836664 [ 2542 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 6496): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:0: DB::PartMergerWriter::mutateOriginalPartAndPrepareProjections() @ 0x000000003d698617 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:04.836693 [ 2526 ] {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 521. DB::ErrnoException: Paths cannot be exchanged because /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1 or /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/delete_tmp_tmp_merge_202409_62_67_1 does not exist, errno: 2, strerror: No such file or directory. (ATOMIC_RENAME_FAIL), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:219: DB::throwFromErrno(String const&, int, int) @ 0x000000002084f090 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/atomicRename.cpp:0: DB::renameat2(String const&, String const&, int) @ 0x00000000370e98c9 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/atomicRename.cpp:208: DB::renameNoReplace(String const&, String const&) @ 0x00000000370e8604 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DiskLocal::moveFile(String const&, String const&) @ 0x0000000037249480 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:207: DB::MoveFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x0000000037300c1c in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:171: DB::DiskObjectStorage::moveFile(String const&, String const&, bool) @ 0x000000003730ae52 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:199: DB::DiskObjectStorage::moveFile(String const&, String const&) @ 0x000000003730b658 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.h:118: DB::DiskObjectStorage::moveDirectory(String const&, String const&) @ 0x0000000037320540 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc014ad in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:227: DB::MergeTreeDataPartCompact::~MergeTreeDataPartCompact() @ 0x000000003d0f272c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartCompact, std::allocator<DB::MergeTreeDataPartCompact>>::__on_zero_shared() @ 0x000000003d0c93c1 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::IMergeTreeDataPartWriter::~IMergeTreeDataPartWriter() @ 0x000000003d13755b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:42: DB::MergeTreeDataPartWriterOnDisk::~MergeTreeDataPartWriterOnDisk() @ 0x000000003d12b6e7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:10: DB::MergeTreeDataPartWriterCompact::~MergeTreeDataPartWriterCompact() @ 0x000000003d12a4ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:10: DB::MergeTreeDataPartWriterCompact::~MergeTreeDataPartWriterCompact() @ 0x000000003d12a6ae in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:119: DB::IMergedBlockOutputStream::~IMergedBlockOutputStream() @ 0x000000003cbabb31 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.h:14: DB::MergedBlockOutputStream::~MergedBlockOutputStream() @ 0x000000003cba16e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergedBlockOutputStream, std::allocator<DB::MergedBlockOutputStream>>::__on_zero_shared() @ 0x000000003cdefb6d in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MergeTask::GlobalRuntimeContext::~GlobalRuntimeContext() @ 0x000000003cdfa4b5 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTask::GlobalRuntimeContext, std::allocator<DB::MergeTask::GlobalRuntimeContext>>::__on_zero_shared() @ 0x000000003cdf96ed in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: std::__shared_ptr_emplace<DB::MergeTask, std::allocator<DB::MergeTask>>::__on_zero_shared() @ 0x000000003cdf39de in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad0227 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbec9 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:05.459357 [ 3982 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:05.459411 [ 2782 ] {96d9a0ea-bd60-4178-beb0-f3411d9357ea} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Array(UInt8) of limit argument of function arrayPartialSort (must be UInt or Int): While processing arrayPartialSort(arraySort([1, 2, 3]), [1, 2, 3]). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<true, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db7b8d4 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db76359 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:40:05.459438 [ 6603 ] {caa082f9-ad0a-4b1d-9206-03424ab9417b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53514) (comment: 00088_global_in_one_shard_and_rows_before_limit.sql) (in query: SELECT EventDate, count() FROM remote('127.0.0.1', test.hits) WHERE UserID GLOBAL IN (SELECT UserID FROM test.hits) GROUP BY EventDate ORDER BY EventDate LIMIT 5 FORMAT JSONCompact;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromPocoSocket::WriteBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x00000000210a2eff in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::WriteBufferFromPocoSocket> std::make_shared[abi:v15000]<DB::WriteBufferFromPocoSocket, Poco::Net::StreamSocket&, void>(Poco::Net::StreamSocket&) @ 0x0000000039451ddf in /usr/bin/clickhouse
12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000003dd6c71a in /usr/bin/clickhouse
13. ./build_docker/./src/Client/Connection.cpp:435: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000003dd76efe in /usr/bin/clickhouse
14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:0: DB::ConnectionEstablisher::run(PoolWithFailoverBase<DB::IConnectionPool>::TryResult&, String&) @ 0x000000003ddd3b17 in /usr/bin/clickhouse
15. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003ddd7f7c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:40:05.459860 [ 19034 ] {} <Error> ExternalDictionariesLoader: Could not update external dictionary '81e60cff-6435-46d5-a273-0228ad10ee5e', leaving the previous version, next update is scheduled at 2024-09-24 02:40:16: Code: 60. DB::Exception: Table test_13.dictionary_decimal_source_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:171: DB::ClickHouseDictionarySource::createStreamForQuery(String const&) @ 0x000000002b0af62b in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:113: DB::ClickHouseDictionarySource::loadAll() @ 0x000000002b0af3b5 in /usr/bin/clickhouse
17. DB::FlatDictionary::loadData() @ 0x000000002b2d750b in /usr/bin/clickhouse
18. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
19. std::shared_ptr<DB::FlatDictionary> std::allocate_shared[abi:v15000]<DB::FlatDictionary, std::allocator<DB::FlatDictionary>, DB::StorageID, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&, void>(std::allocator<DB::FlatDictionary> const&, DB::StorageID&&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>&&, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&) @ 0x000000002b356569 in /usr/bin/clickhouse
20. DB::FlatDictionary::clone() const @ 0x000000002b33fd64 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc12ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:05.459911 [ 2351 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:05.459919 [ 3239 ] {5992a919-0787-4ade-8298-277debda5f55} <Error> executeQuery: Code: 42. DB::Exception: Table name was not found in function arguments. Table function 'remote' requires from 1 to 6 parameters: <addresses pattern> [, <name of remote database>, <name of remote table>] [, username[, password], sharding_key]. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: select * from remote('127.0.0.1', system);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const>(int, FormatStringHelperImpl<std::type_identity<String const>::type>, String const&&) @ 0x00000000349ef775 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:178: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7faa in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:05.460113 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:08.254598 [ 2538 ] {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 521. DB::ErrnoException: Paths cannot be exchanged because /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1 or /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/delete_tmp_tmp_merge_202409_68_72_1 does not exist, errno: 2, strerror: No such file or directory. (ATOMIC_RENAME_FAIL), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:219: DB::throwFromErrno(String const&, int, int) @ 0x000000002084f090 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/atomicRename.cpp:0: DB::renameat2(String const&, String const&, int) @ 0x00000000370e98c9 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/atomicRename.cpp:208: DB::renameNoReplace(String const&, String const&) @ 0x00000000370e8604 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DiskLocal::moveFile(String const&, String const&) @ 0x0000000037249480 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:207: DB::MoveFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x0000000037300c1c in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:171: DB::DiskObjectStorage::moveFile(String const&, String const&, bool) @ 0x000000003730ae52 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:199: DB::DiskObjectStorage::moveFile(String const&, String const&) @ 0x000000003730b658 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.h:118: DB::DiskObjectStorage::moveDirectory(String const&, String const&) @ 0x0000000037320540 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc014ad in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:227: DB::MergeTreeDataPartCompact::~MergeTreeDataPartCompact() @ 0x000000003d0f272c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartCompact, std::allocator<DB::MergeTreeDataPartCompact>>::__on_zero_shared() @ 0x000000003d0c93c1 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::IMergeTreeDataPartWriter::~IMergeTreeDataPartWriter() @ 0x000000003d13755b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:42: DB::MergeTreeDataPartWriterOnDisk::~MergeTreeDataPartWriterOnDisk() @ 0x000000003d12b6e7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:10: DB::MergeTreeDataPartWriterCompact::~MergeTreeDataPartWriterCompact() @ 0x000000003d12a4ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:10: DB::MergeTreeDataPartWriterCompact::~MergeTreeDataPartWriterCompact() @ 0x000000003d12a6ae in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:119: DB::IMergedBlockOutputStream::~IMergedBlockOutputStream() @ 0x000000003cbabb31 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.h:14: DB::MergedBlockOutputStream::~MergedBlockOutputStream() @ 0x000000003cba16e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergedBlockOutputStream, std::allocator<DB::MergedBlockOutputStream>>::__on_zero_shared() @ 0x000000003cdefb6d in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MergeTask::GlobalRuntimeContext::~GlobalRuntimeContext() @ 0x000000003cdfa4b5 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTask::GlobalRuntimeContext, std::allocator<DB::MergeTask::GlobalRuntimeContext>>::__on_zero_shared() @ 0x000000003cdf96ed in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: std::__shared_ptr_emplace<DB::MergeTask, std::allocator<DB::MergeTask>>::__on_zero_shared() @ 0x000000003cdf39de in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad0227 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbec9 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:08.255078 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_78_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:269: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66b425 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:08.355276 [ 2526 ] {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1} <Error> void DB::IMergeTreeDataPart::removeIfNeeded(): while removing part 202409_62_67_1 with path store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/: Code: 521. DB::ErrnoException: Paths cannot be exchanged because /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/delete_tmp_tmp_merge_202409_62_67_1 or /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1 does not exist, errno: 2, strerror: No such file or directory: While rolling back operation #0. (ATOMIC_RENAME_FAIL), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:219: DB::throwFromErrno(String const&, int, int) @ 0x000000002084f090 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/atomicRename.cpp:0: DB::renameat2(String const&, String const&, int) @ 0x00000000370e98c9 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/atomicRename.cpp:208: DB::renameNoReplace(String const&, String const&) @ 0x00000000370e8604 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DiskLocal::moveFile(String const&, String const&) @ 0x0000000037249480 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:212: DB::MoveFileOperation::undo() @ 0x0000000037300c9c in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x00000000372e4e1d in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4d20 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:171: DB::DiskObjectStorage::moveFile(String const&, String const&, bool) @ 0x000000003730ae52 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:199: DB::DiskObjectStorage::moveFile(String const&, String const&) @ 0x000000003730b658 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.h:118: DB::DiskObjectStorage::moveDirectory(String const&, String const&) @ 0x0000000037320540 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc014ad in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:227: DB::MergeTreeDataPartCompact::~MergeTreeDataPartCompact() @ 0x000000003d0f272c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartCompact, std::allocator<DB::MergeTreeDataPartCompact>>::__on_zero_shared() @ 0x000000003d0c93c1 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::IMergeTreeDataPartWriter::~IMergeTreeDataPartWriter() @ 0x000000003d13755b in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:42: DB::MergeTreeDataPartWriterOnDisk::~MergeTreeDataPartWriterOnDisk() @ 0x000000003d12b6e7 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:10: DB::MergeTreeDataPartWriterCompact::~MergeTreeDataPartWriterCompact() @ 0x000000003d12a4ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:10: DB::MergeTreeDataPartWriterCompact::~MergeTreeDataPartWriterCompact() @ 0x000000003d12a6ae in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:119: DB::IMergedBlockOutputStream::~IMergedBlockOutputStream() @ 0x000000003cbabb31 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.h:14: DB::MergedBlockOutputStream::~MergedBlockOutputStream() @ 0x000000003cba16e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergedBlockOutputStream, std::allocator<DB::MergedBlockOutputStream>>::__on_zero_shared() @ 0x000000003cdefb6d in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MergeTask::GlobalRuntimeContext::~GlobalRuntimeContext() @ 0x000000003cdfa4b5 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTask::GlobalRuntimeContext, std::allocator<DB::MergeTask::GlobalRuntimeContext>>::__on_zero_shared() @ 0x000000003cdf96ed in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: std::__shared_ptr_emplace<DB::MergeTask, std::allocator<DB::MergeTask>>::__on_zero_shared() @ 0x000000003cdf39de in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad0227 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbec9 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:08.408837 [ 2539 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:09.236035 [ 3994 ] {251c79bb-1023-43ac-81d2-d160fe5ae975} <Error> executeQuery: Code: 36. DB::Exception: Cannot alter settings, because table engine doesn't support settings changes. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53508) (comment: 01089_alter_settings_old_format.sql) (in query: ALTER TABLE old_format_mt MODIFY SETTING enable_mixed_granularity_parts = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:09.236136 [ 3239 ] {5992a919-0787-4ade-8298-277debda5f55} <Error> TCPHandler: Code: 42. DB::Exception: Table name was not found in function arguments. Table function 'remote' requires from 1 to 6 parameters: <addresses pattern> [, <name of remote database>, <name of remote table>] [, username[, password], sharding_key]. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const>(int, FormatStringHelperImpl<std::type_identity<String const>::type>, String const&&) @ 0x00000000349ef775 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:178: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7faa in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:09.236322 [ 6603 ] {caa082f9-ad0a-4b1d-9206-03424ab9417b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromPocoSocket::WriteBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x00000000210a2eff in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::WriteBufferFromPocoSocket> std::make_shared[abi:v15000]<DB::WriteBufferFromPocoSocket, Poco::Net::StreamSocket&, void>(Poco::Net::StreamSocket&) @ 0x0000000039451ddf in /usr/bin/clickhouse
12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000003dd6c71a in /usr/bin/clickhouse
13. ./build_docker/./src/Client/Connection.cpp:435: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000003dd76efe in /usr/bin/clickhouse
14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:0: DB::ConnectionEstablisher::run(PoolWithFailoverBase<DB::IConnectionPool>::TryResult&, String&) @ 0x000000003ddd3b17 in /usr/bin/clickhouse
15. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003ddd7f7c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:40:09.236483 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:09.236480 [ 3186 ] {d23a7030-10ac-4d7f-a51b-6a10794555e6} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44954) (comment: 00158_cache_dictionary_has.sql) (in query: SELECT count() from test.hits PREWHERE WatchID % 350 == 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:09.236582 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:09.236600 [ 2356 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:09.236643 [ 2538 ] {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1} <Error> void DB::IMergeTreeDataPart::removeIfNeeded(): while removing part 202409_68_72_1 with path store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1/: Code: 521. DB::ErrnoException: Paths cannot be exchanged because /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/delete_tmp_tmp_merge_202409_68_72_1 or /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_68_72_1 does not exist, errno: 2, strerror: No such file or directory: While rolling back operation #0. (ATOMIC_RENAME_FAIL), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:219: DB::throwFromErrno(String const&, int, int) @ 0x000000002084f090 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/atomicRename.cpp:0: DB::renameat2(String const&, String const&, int) @ 0x00000000370e98c9 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/atomicRename.cpp:208: DB::renameNoReplace(String const&, String const&) @ 0x00000000370e8604 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DiskLocal::moveFile(String const&, String const&) @ 0x0000000037249480 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:212: DB::MoveFileOperation::undo() @ 0x0000000037300c9c in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x00000000372e4e1d in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4d20 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:171: DB::DiskObjectStorage::moveFile(String const&, String const&, bool) @ 0x000000003730ae52 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:199: DB::DiskObjectStorage::moveFile(String const&, String const&) @ 0x000000003730b658 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.h:118: DB::DiskObjectStorage::moveDirectory(String const&, String const&) @ 0x0000000037320540 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc014ad in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:227: DB::MergeTreeDataPartCompact::~MergeTreeDataPartCompact() @ 0x000000003d0f272c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartCompact, std::allocator<DB::MergeTreeDataPartCompact>>::__on_zero_shared() @ 0x000000003d0c93c1 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::IMergeTreeDataPartWriter::~IMergeTreeDataPartWriter() @ 0x000000003d13755b in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:42: DB::MergeTreeDataPartWriterOnDisk::~MergeTreeDataPartWriterOnDisk() @ 0x000000003d12b6e7 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:10: DB::MergeTreeDataPartWriterCompact::~MergeTreeDataPartWriterCompact() @ 0x000000003d12a4ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:10: DB::MergeTreeDataPartWriterCompact::~MergeTreeDataPartWriterCompact() @ 0x000000003d12a6ae in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:119: DB::IMergedBlockOutputStream::~IMergedBlockOutputStream() @ 0x000000003cbabb31 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.h:14: DB::MergedBlockOutputStream::~MergedBlockOutputStream() @ 0x000000003cba16e7 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergedBlockOutputStream, std::allocator<DB::MergedBlockOutputStream>>::__on_zero_shared() @ 0x000000003cdefb6d in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MergeTask::GlobalRuntimeContext::~GlobalRuntimeContext() @ 0x000000003cdfa4b5 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTask::GlobalRuntimeContext, std::allocator<DB::MergeTask::GlobalRuntimeContext>>::__on_zero_shared() @ 0x000000003cdf96ed in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: std::__shared_ptr_emplace<DB::MergeTask, std::allocator<DB::MergeTask>>::__on_zero_shared() @ 0x000000003cdf39de in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad0227 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbec9 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:10.164183 [ 2528 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmpf2165c79-c9ff-499a-8909-5ed7e9052383' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:40:13.237856 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4221208 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:0: DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x00000000208b106a in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.cpp:0: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x000000003b1bed08 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::IColumn, DB::ColumnString>::clone() const @ 0x000000003b1dcc02 in /usr/bin/clickhouse
10. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
11. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4eadf in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.238051 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 4466397 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.238294 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4284120 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.238363 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1052340 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435e51 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:322: DB::ColumnVector<unsigned long>::insertDefault() @ 0x000000003b2bc895 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::ColumnSparse(COW<DB::IColumn>::mutable_ptr<DB::IColumn>&&) @ 0x000000003b1a1813 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::IDataType::createColumn(DB::ISerialization const&) const @ 0x0000000036dd5efa in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:140: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d473eda in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.238346 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 5073293 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.239290 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 5156673 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.238450 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 4219390 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.238963 [ 3994 ] {251c79bb-1023-43ac-81d2-d160fe5ae975} <Error> TCPHandler: Code: 36. DB::Exception: Cannot alter settings, because table engine doesn't support settings changes. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003b92cb43 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395faba5 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:13.239198 [ 3186 ] {d23a7030-10ac-4d7f-a51b-6a10794555e6} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:13.239326 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1113973 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x00000000208b106a in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.cpp:0: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x000000003b1bed08 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::IColumn, DB::ColumnString>::clone() const @ 0x000000003b1dcc02 in /usr/bin/clickhouse
12. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
13. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.238774 [ 3982 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:13.239581 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 4203197 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:15.281727 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 4194337 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x00000000208bc5ec in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<unsigned long>>::clone() const @ 0x000000003b422c66 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::savingThreadFunction() @ 0x000000003a3f41e2 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c42907 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c427df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:15.281905 [ 2461 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:15.282001 [ 2361 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:15.281963 [ 2782 ] {fb6d9817-d3b2-44fd-9356-dbd1c88eb1cb} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Array(Array(UInt8)) of limit argument of function arrayPartialSort (must be UInt or Int): While processing arrayMap(x -> range(x), [4, 1, 2, 3]) AS arr, 100 AS lim, arrayResize(arrayPartialSort(arrayPartialSort(lim, arr), arr), lim), arrayResize(arrayPartialReverseSort(lim, arr), lim), arrayResize(arrayPartialSort(x -> (-length(x)), lim, arr), lim). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35528) (comment: 00390_array_sort.sql) (in query: SELECT arrayMap(x -> range(x), [4, 1, 2, 3]) AS arr, 100 AS lim, arrayResize(arrayPartialSort(arrayPartialSort(lim, arr), arr), lim), arrayResize(arrayPartialReverseSort(lim, arr), lim), arrayResize(arrayPartialSort(x -> (-length(x)), lim, arr), lim);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<true, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db7b8d4 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db76359 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse

2024.09.24 02:40:15.282040 [ 2539 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:15.282222 [ 3232 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:15.282690 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_79_83_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1089871 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:16.228525 [ 2540 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:16.378004 [ 3983 ] {7f4fbd50-baa4-4610-852b-3925edb45d34} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1376713 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION toString(modulo(number, 100) :: 3) -> toString(modulo(number, 100)) String : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53496) (comment: 00375_shard_group_uniq_array_of_string.sql) (in query: INSERT INTO group_uniq_str SELECT 2 as id, toString(number % 100) as v FROM system.numbers LIMIT 1000000;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. DB::ConvertImpl<DB::DataTypeNumber<char8_t>, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) @ 0x0000000009f2eb34 in /usr/bin/clickhouse
11. bool DB::callOnIndexAndDataType<DB::DataTypeString, DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009f285b2 in /usr/bin/clickhouse
12. DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009f27f3f in /usr/bin/clickhouse
13. DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009f26862 in /usr/bin/clickhouse
14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
15. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
16. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
17. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:18.303047 [ 3182 ] {be8cd8cb-d7f8-443d-b2f5-847c54ee2a30} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53510) (comment: 01835_alias_to_primary_key_cyfdecyf.sql) (in query: insert into tb values ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse

2024.09.24 02:40:19.298150 [ 21628 ] {f9578bbb-896e-4ab3-a683-a6d1d0329f5c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53548) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSKV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a984e in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f27dda in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:40:19.298254 [ 3980 ] {8738e9bd-f496-4644-bda6-91de216f6452} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1556480 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53540) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:40:19.298229 [ 21629 ] {902d3c4c-6597-47f5-9d6f-2bc5c29a2c40} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1190498 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53556) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:21.487622 [ 3990 ] {a2378c4b-96b1-4a10-bebd-6644aebec23e} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53528) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:40:23.394163 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 4240894 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:23.394284 [ 3991 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:23.394274 [ 3239 ] {b011cb44-ae7b-4ca1-b29a-3cd62a40f4a5} <Error> executeQuery: Code: 60. DB::Exception: Table system.o does not exist. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: select * from remote('127.0.0.1', system.o);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/getStructureOfRemoteTable.cpp:51: DB::getStructureOfRemoteTableInShard(DB::Cluster const&, DB::Cluster::ShardInfo const&, DB::StorageID const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&) @ 0x000000003c589968 in /usr/bin/clickhouse
7. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:677: DB::getStructureOfRemoteTable(DB::Cluster const&, DB::StorageID const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&) @ 0x000000003c5944f0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionRemote::getActualTableStructure(std::shared_ptr<DB::Context const>, bool) const @ 0x00000000349eca19 in /usr/bin/clickhouse
9. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x00000000349ea62c in /usr/bin/clickhouse
10. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:23.394372 [ 2782 ] {fb6d9817-d3b2-44fd-9356-dbd1c88eb1cb} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Array(Array(UInt8)) of limit argument of function arrayPartialSort (must be UInt or Int): While processing arrayMap(x -> range(x), [4, 1, 2, 3]) AS arr, 100 AS lim, arrayResize(arrayPartialSort(arrayPartialSort(lim, arr), arr), lim), arrayResize(arrayPartialReverseSort(lim, arr), lim), arrayResize(arrayPartialSort(x -> (-length(x)), lim, arr), lim). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<true, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db7b8d4 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db76359 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse

2024.09.24 02:40:23.394537 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:25.000817 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:25.000782 [ 3232 ] {e22879f7-91fa-4422-9e94-5ae033122ff4} <Error> executeQuery: Code: 630. DB::Exception: Cannot drop or rename test.hits, because some tables depend on it: db_dict.cache_hits. (HAVE_DEPENDENT_OBJECTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52960) (comment: 00140_rename.sql) (in query: RENAME TABLE test.hits TO test.visits_tmp, test.visits TO test.hits, test.visits_tmp TO test.visits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<DB::StorageID const&, fmt::v8::join_view<std::__wrap_iter<DB::StorageID*>, std::__wrap_iter<DB::StorageID*>, char>>(int, FormatStringHelperImpl<std::type_identity<DB::StorageID const&>::type, std::type_identity<fmt::v8::join_view<std::__wrap_iter<DB::StorageID*>, std::__wrap_iter<DB::StorageID*>, char>>::type>, DB::StorageID const&, fmt::v8::join_view<std::__wrap_iter<DB::StorageID*>, std::__wrap_iter<DB::StorageID*>, char>&&) @ 0x0000000037b100a2 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:1422: DB::DatabaseCatalog::checkTableCanBeRemovedOrRenamedUnlocked(DB::StorageID const&, bool, bool, bool) const @ 0x0000000037aff90b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::removeDependencies(DB::StorageID const&, bool, bool, bool) @ 0x0000000037afe665 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector<DB::RenameDescription, std::allocator<DB::RenameDescription>> const&, std::map<DB::UniqueTableName, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>, std::less<DB::UniqueTableName>, std::allocator<std::pair<DB::UniqueTableName const, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>>>>&) @ 0x0000000039afce7c in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::execute() @ 0x0000000039af713d in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:25.001013 [ 3983 ] {7f4fbd50-baa4-4610-852b-3925edb45d34} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1376713 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION toString(modulo(number, 100) :: 3) -> toString(modulo(number, 100)) String : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. DB::ConvertImpl<DB::DataTypeNumber<char8_t>, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) @ 0x0000000009f2eb34 in /usr/bin/clickhouse
11. bool DB::callOnIndexAndDataType<DB::DataTypeString, DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009f285b2 in /usr/bin/clickhouse
12. DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009f27f3f in /usr/bin/clickhouse
13. DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009f26862 in /usr/bin/clickhouse
14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
15. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
16. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
17. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:25.001115 [ 2540 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:25.001152 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4707550 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:25.001184 [ 3182 ] {be8cd8cb-d7f8-443d-b2f5-847c54ee2a30} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse

2024.09.24 02:40:25.001285 [ 2375 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:25.001418 [ 21629 ] {902d3c4c-6597-47f5-9d6f-2bc5c29a2c40} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1190498 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:25.001503 [ 3239 ] {b011cb44-ae7b-4ca1-b29a-3cd62a40f4a5} <Error> TCPHandler: Code: 60. DB::Exception: Table system.o does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/getStructureOfRemoteTable.cpp:51: DB::getStructureOfRemoteTableInShard(DB::Cluster const&, DB::Cluster::ShardInfo const&, DB::StorageID const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&) @ 0x000000003c589968 in /usr/bin/clickhouse
7. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:677: DB::getStructureOfRemoteTable(DB::Cluster const&, DB::StorageID const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&) @ 0x000000003c5944f0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionRemote::getActualTableStructure(std::shared_ptr<DB::Context const>, bool) const @ 0x00000000349eca19 in /usr/bin/clickhouse
9. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x00000000349ea62c in /usr/bin/clickhouse
10. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:25.001301 [ 18431 ] {} <Error> ExternalDictionariesLoader: Could not update external dictionary '81e60cff-6435-46d5-a273-0228ad10ee5e', leaving the previous version, next update is scheduled at 2024-09-24 02:41:03: Code: 60. DB::Exception: Table test_13.dictionary_decimal_source_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:171: DB::ClickHouseDictionarySource::createStreamForQuery(String const&) @ 0x000000002b0af62b in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:113: DB::ClickHouseDictionarySource::loadAll() @ 0x000000002b0af3b5 in /usr/bin/clickhouse
17. DB::FlatDictionary::loadData() @ 0x000000002b2d750b in /usr/bin/clickhouse
18. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
19. std::shared_ptr<DB::FlatDictionary> std::allocate_shared[abi:v15000]<DB::FlatDictionary, std::allocator<DB::FlatDictionary>, DB::StorageID, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&, void>(std::allocator<DB::FlatDictionary> const&, DB::StorageID&&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>&&, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&) @ 0x000000002b356569 in /usr/bin/clickhouse
20. DB::FlatDictionary::clone() const @ 0x000000002b33fd64 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc12ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:25.001263 [ 3980 ] {8738e9bd-f496-4644-bda6-91de216f6452} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1556480 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:40:25.001440 [ 3990 ] {a2378c4b-96b1-4a10-bebd-6644aebec23e} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:40:25.001768 [ 6603 ] {b18e0905-96b8-41db-a200-01856c9f40da} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53080) (comment: 00062_loyalty.sql) (in query: SELECT loyalty, count() AS c, bar(log(c + 1) * 1000, 0, log(6000) * 1000, 80) FROM (SELECT UserID, toInt8((yandex > google ? yandex / (yandex + google) : -google / (yandex + google)) * 10) AS loyalty FROM (SELECT UserID, sum(SearchEngineID = 2) AS yandex, sum(SearchEngineID = 3) AS google FROM test.hits WHERE SearchEngineID = 2 OR SearchEngineID = 3 GROUP BY UserID HAVING yandex + google > 10)) GROUP BY loyalty ORDER BY loyalty), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:25.001280 [ 21628 ] {f9578bbb-896e-4ab3-a683-a6d1d0329f5c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a984e in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f27dda in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:40:25.003089 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1050593 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435e51 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd78e in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:25.004538 [ 3232 ] {e22879f7-91fa-4422-9e94-5ae033122ff4} <Error> TCPHandler: Code: 630. DB::Exception: Cannot drop or rename test.hits, because some tables depend on it: db_dict.cache_hits. (HAVE_DEPENDENT_OBJECTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<DB::StorageID const&, fmt::v8::join_view<std::__wrap_iter<DB::StorageID*>, std::__wrap_iter<DB::StorageID*>, char>>(int, FormatStringHelperImpl<std::type_identity<DB::StorageID const&>::type, std::type_identity<fmt::v8::join_view<std::__wrap_iter<DB::StorageID*>, std::__wrap_iter<DB::StorageID*>, char>>::type>, DB::StorageID const&, fmt::v8::join_view<std::__wrap_iter<DB::StorageID*>, std::__wrap_iter<DB::StorageID*>, char>&&) @ 0x0000000037b100a2 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:1422: DB::DatabaseCatalog::checkTableCanBeRemovedOrRenamedUnlocked(DB::StorageID const&, bool, bool, bool) const @ 0x0000000037aff90b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::removeDependencies(DB::StorageID const&, bool, bool, bool) @ 0x0000000037afe665 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector<DB::RenameDescription, std::allocator<DB::RenameDescription>> const&, std::map<DB::UniqueTableName, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>, std::less<DB::UniqueTableName>, std::allocator<std::pair<DB::UniqueTableName const, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>>>>&) @ 0x0000000039afce7c in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::execute() @ 0x0000000039af713d in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:25.007181 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1103695 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:27.604200 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:27.623893 [ 2782 ] {b4e56f4a-6068-43f9-8285-5d0b6e3fe185} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Array(Nullable(Nothing)) of limit argument of function arrayPartialReverseSort (must be UInt or Int): While processing arrayPartialReverseSort(arraySort((x, y) -> y, [NULL, NULL], [NULL, NULL]), arrayMap(x -> toString(x), [257, -9223372036854775807, 2, -2147483648, 2147483648, NULL, 65536, -2147483648, 2, 65535]) AS arr), arr, NULL, 100 AS lim, 65536, arrayResize(arrayPartialSort(x -> reverse(x), lim, arr), lim). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35528) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialReverseSort(arraySort((x, y) -> y, [NULL, NULL], [NULL, NULL]), arr), arrayMap(x -> toString(x), [257, -9223372036854775807, 2, -2147483648, 2147483648, NULL, 65536, -2147483648, 2, 65535]) AS arr, NULL, 100 AS lim, 65536, arrayResize(arrayPartialSort(x -> reverse(x), lim, arr), lim) GROUP BY [NULL, 1023, -2, NULL, 255, '0', NULL, 9223372036854775806] WITH ROLLUP;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<false, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db8cb74 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<false, true>, DB::NameArrayPartialReverseSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db875f9 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:40:29.474332 [ 6603 ] {b18e0905-96b8-41db-a200-01856c9f40da} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:29.474492 [ 3239 ] {ed87fa94-c9d4-41b2-aa7c-5f408e3a49b2} <Error> executeQuery: Code: 47. DB::Exception: Missing columns: 'default' while processing query: 'default', required columns: 'default' 'default'. (UNKNOWN_IDENTIFIER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: select * from remote('127.0.0.1', system.one, default);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1356: DB::TreeRewriter::analyze(std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::IStorage const>, std::shared_ptr<DB::StorageSnapshot> const&, bool, bool, bool, bool) const @ 0x000000003a70e97d in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageDistributed.cpp:218: DB::(anonymous namespace)::buildShardingKeyExpression(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, DB::NamesAndTypesList const&, bool) @ 0x000000003bb62ad0 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::StorageDistributed(DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&, String const&, String const&, DB::DistributedSettings const&, bool, std::shared_ptr<DB::Cluster>, std::shared_ptr<DB::IAST>) @ 0x000000003bb5d017 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageDistributed> std::allocate_shared[abi:v15000]<DB::StorageDistributed, std::allocator<DB::StorageDistributed>, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, String const&, String const&, String, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::IAST> const&, String, String, DB::DistributedSettings, bool, std::shared_ptr<DB::Cluster> const&, void>(std::allocator<DB::StorageDistributed> const&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, String const&, String const&, String&&, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::IAST> const&, String&&, String&&, DB::DistributedSettings&&, bool&&, std::shared_ptr<DB::Cluster> const&) @ 0x00000000349f41a7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionRemote::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x00000000349eb482 in /usr/bin/clickhouse
9. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:29.475795 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:29.475920 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:29.476528 [ 2782 ] {b4e56f4a-6068-43f9-8285-5d0b6e3fe185} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Array(Nullable(Nothing)) of limit argument of function arrayPartialReverseSort (must be UInt or Int): While processing arrayPartialReverseSort(arraySort((x, y) -> y, [NULL, NULL], [NULL, NULL]), arrayMap(x -> toString(x), [257, -9223372036854775807, 2, -2147483648, 2147483648, NULL, 65536, -2147483648, 2, 65535]) AS arr), arr, NULL, 100 AS lim, 65536, arrayResize(arrayPartialSort(x -> reverse(x), lim, arr), lim). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<false, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db8cb74 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<false, true>, DB::NameArrayPartialReverseSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db875f9 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:40:31.831133 [ 2531 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ff416 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:271: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000003730f415 in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:279: DB::DiskObjectStorage::createHardLink(String const&, String const&) @ 0x000000003730f7f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Disks/FakeDiskTransaction.h:135: DB::FakeDiskTransaction::createHardLink(String const&, String const&) @ 0x000000003728b851 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DataPartStorageOnDiskFull::createHardLinkFrom(DB::IDataPartStorage const&, String const&, String const&) @ 0x000000003cbcc728 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:0: DB::MutateSomePartColumnsTask::prepare() @ 0x000000003d6fe075 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1501: DB::MutateSomePartColumnsTask::executeStep() @ 0x000000003d6fc715 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x000000003d69f9b2 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad5f1d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:31.833753 [ 2531 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:34.366209 [ 3991 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:34.366339 [ 3239 ] {ed87fa94-c9d4-41b2-aa7c-5f408e3a49b2} <Error> TCPHandler: Code: 47. DB::Exception: Missing columns: 'default' while processing query: 'default', required columns: 'default' 'default'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1356: DB::TreeRewriter::analyze(std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::IStorage const>, std::shared_ptr<DB::StorageSnapshot> const&, bool, bool, bool, bool) const @ 0x000000003a70e97d in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageDistributed.cpp:218: DB::(anonymous namespace)::buildShardingKeyExpression(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, DB::NamesAndTypesList const&, bool) @ 0x000000003bb62ad0 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::StorageDistributed(DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&, String const&, String const&, DB::DistributedSettings const&, bool, std::shared_ptr<DB::Cluster>, std::shared_ptr<DB::IAST>) @ 0x000000003bb5d017 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageDistributed> std::allocate_shared[abi:v15000]<DB::StorageDistributed, std::allocator<DB::StorageDistributed>, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, String const&, String const&, String, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::IAST> const&, String, String, DB::DistributedSettings, bool, std::shared_ptr<DB::Cluster> const&, void>(std::allocator<DB::StorageDistributed> const&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, String const&, String const&, String&&, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::IAST> const&, String&&, String&&, DB::DistributedSettings&&, bool&&, std::shared_ptr<DB::Cluster> const&) @ 0x00000000349f41a7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionRemote::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x00000000349eb482 in /usr/bin/clickhouse
9. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:34.366467 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:34.366423 [ 22369 ] {a640f057-4396-4c27-826c-ffb28a7a4a79} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43390) (comment: 00820_multiple_joins_subquery_requires_alias.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:34.366590 [ 2339 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:34.366827 [ 3980 ] {eb6e9487-f8cf-4445-aaf5-2417de286aec} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42708) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:35.185295 [ 2564 ] {} <Warning> test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3): Removing temporary directory /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/tmp_merge_201403_1_8_1/
2024.09.24 02:40:35.185391 [ 2564 ] {} <Warning> test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/tmp_merge_201403_1_8_1/
2024.09.24 02:40:35.876645 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 5060933 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:35.877323 [ 2531 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4 (to which part must be renamed before removing) already exists. Most likely this is due to unclean restart or race condition. Removing it.
2024.09.24 02:40:35.879861 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4219390 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:38.736363 [ 2558 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Removing temporary directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:40:38.736467 [ 2558 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:40:39.240945 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4198503 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. DB::PODArray<DB::DateTime64, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000000946421f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnDecimal.h:35: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnDecimal<DB::DateTime64>::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08170d in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/ColumnDecimal.cpp:230: DB::ColumnDecimal<DB::DateTime64>::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003ae11be6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPartWriter.cpp:0: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d135ce2 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:166: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11e92d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4eadf in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:39.241095 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5162717 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::savingThreadFunction() @ 0x000000003a42c002 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c45ea7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:40.428005 [ 2567 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:40:40.428117 [ 2567 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:40:42.193888 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4203453 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:42.193955 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4956117 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:42.194010 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5218812 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:43.366761 [ 2563 ] {} <Warning> system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70): Removing temporary directory /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_83_19/
2024.09.24 02:40:43.451118 [ 2563 ] {} <Warning> system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_83_19/
2024.09.24 02:40:47.776670 [ 4381 ] {11619166-a9f4-4fa2-ab00-ab4658d436c6} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42882) (comment: 02896_memory_accounting_for_user.sh) (in query: INSERT INTO test_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.355639 [ 22286 ] {4239bfb8-af80-484e-98f4-2e03439421ad} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43020) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.355640 [ 22316 ] {1418c78a-8eba-45e2-81cd-341cd5b564b8} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43102) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.355690 [ 22323 ] {67f545a0-72fa-4c8c-abdb-9bc9baad5258} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43134) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.355692 [ 22297 ] {302202d5-5d24-4027-a4a4-f90e0aa473e7} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43044) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.355877 [ 3101 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:48.355866 [ 22313 ] {d8c0a446-427e-4e32-92db-7678a9a5b193} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43080) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356049 [ 22369 ] {a640f057-4396-4c27-826c-ffb28a7a4a79} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356238 [ 22337 ] {7917cb33-4500-48b0-b196-45d588f29c62} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43220) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356254 [ 22325 ] {796b3299-9421-4f2b-a09d-8f304a0b9be0} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43154) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356557 [ 2531 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:48.356365 [ 2350 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:48.356654 [ 3980 ] {eb6e9487-f8cf-4445-aaf5-2417de286aec} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356907 [ 3992 ] {64ad36b6-4442-44b1-b572-ad207d428081} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42790) (comment: 02896_memory_accounting_for_user.sh) (in query: INSERT INTO test_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356445 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:48.356596 [ 6603 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:48.356636 [ 3990 ] {45b38888-0c09-42dc-97db-ffba0de68df8} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42702) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356863 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1064399 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_1_1_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 2 with max_rows_to_read = 6682): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:48.356962 [ 3983 ] {00feb8df-8506-4d18-8ebc-bf6fb2b3cbfa} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42922) (comment: 02896_memory_accounting_for_user.sh) (in query: INSERT INTO test_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356286 [ 2759 ] {e914c137-57da-4c9a-86de-2fd6847209b2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42938) (comment: 02896_memory_accounting_for_user.sh) (in query: INSERT INTO test_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.355953 [ 22300 ] {14653c8e-dfe3-4be0-9a2e-639cf0f7e4ad} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43048) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.356799 [ 22348 ] {f96af168-f531-4ec2-a680-344be249e325} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43296) (comment: 02896_memory_accounting_for_user.sh) (in query: INSERT INTO test_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.358524 [ 3154 ] {8b7e1690-39e6-4f44-bdfc-0e118f88b3ed} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42748) (comment: 02896_memory_accounting_for_user.sh) (in query: INSERT INTO test_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.360281 [ 22340 ] {80e9526d-daf1-4696-be19-8692d9c49298} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 8388944 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43254) (comment: 02896_memory_accounting_for_user.sh) (in query: INSERT INTO test_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.360296 [ 22333 ] {47106ba4-e8d6-4eee-ad7b-87cc9b8a31ab} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43198) (comment: 02896_memory_accounting_for_user.sh) (in query: INSERT INTO test_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:48.363384 [ 2531 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Cannot recursively remove directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4. Exception: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While committing metadata operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:49.505795 [ 4381 ] {11619166-a9f4-4fa2-ab00-ab4658d436c6} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.505866 [ 21629 ] {de50bffd-1bfa-4de9-a561-caff8bd290b7} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1441792 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ParsedParams.Key1): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_4_4_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 36610): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42732) (comment: 00053_replicate_segfault.sql) (in query: SELECT count() > 0 FROM (SELECT ParsedParams.Key1 AS p FROM test.visits WHERE arrayAll(y -> arrayExists(x -> y != x, p), p)) ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::SerializationNamed::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036f6f42c in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse

2024.09.24 02:40:49.505919 [ 22370 ] {59c2c5df-d573-43f7-a85a-9a3293b48ba5} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1124501 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43400) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.505875 [ 6601 ] {21b6289e-12e1-4f52-89ad-c183daea5a8f} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43402) (comment: 00050_min_max.sql) (in query: SELECT CounterID, min(WatchID), max(WatchID) FROM test.hits GROUP BY CounterID ORDER BY count() DESC LIMIT 20;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.506076 [ 2759 ] {e914c137-57da-4c9a-86de-2fd6847209b2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.505986 [ 2905 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:49.506055 [ 3983 ] {00feb8df-8506-4d18-8ebc-bf6fb2b3cbfa} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.506264 [ 22337 ] {7917cb33-4500-48b0-b196-45d588f29c62} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.506355 [ 3992 ] {64ad36b6-4442-44b1-b572-ad207d428081} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.506142 [ 22313 ] {d8c0a446-427e-4e32-92db-7678a9a5b193} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.506338 [ 22323 ] {67f545a0-72fa-4c8c-abdb-9bc9baad5258} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.506898 [ 22316 ] {1418c78a-8eba-45e2-81cd-341cd5b564b8} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.506935 [ 22297 ] {302202d5-5d24-4027-a4a4-f90e0aa473e7} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.506990 [ 22286 ] {4239bfb8-af80-484e-98f4-2e03439421ad} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.507403 [ 22348 ] {f96af168-f531-4ec2-a680-344be249e325} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.507943 [ 3154 ] {8b7e1690-39e6-4f44-bdfc-0e118f88b3ed} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.508873 [ 22300 ] {14653c8e-dfe3-4be0-9a2e-639cf0f7e4ad} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.509625 [ 22325 ] {796b3299-9421-4f2b-a09d-8f304a0b9be0} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:49.509792 [ 22333 ] {47106ba4-e8d6-4eee-ad7b-87cc9b8a31ab} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 8388608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:50.084135 [ 2561 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Removing temporary directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/
2024.09.24 02:40:50.084221 [ 2561 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/
2024.09.24 02:40:50.583349 [ 2759 ] {} <Error> TCPHandler: Code: 101. DB::NetException: Unexpected packet Hello received from client. (UNEXPECTED_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::NetException::NetException<char const (&) [45]>(int, char const (&) [45]) @ 0x000000003e0f68b6 in /usr/bin/clickhouse
3. ./build_docker/./src/Server/TCPHandler.cpp:1388: DB::TCPHandler::receiveUnexpectedHello() @ 0x000000003e0d8ba4 in /usr/bin/clickhouse
4. ./build_docker/./src/Server/TCPHandler.cpp:1443: DB::TCPHandler::receivePacket() @ 0x000000003e0bfcc4 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:50.583558 [ 2531 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> void DB::IMergeTreeDataPart::removeIfNeeded(): while removing part all_1_1_1_4 with path store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While committing metadata operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.307891 [ 3990 ] {45b38888-0c09-42dc-97db-ffba0de68df8} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.308050 [ 2384 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.308065 [ 2950 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.308465 [ 3239 ] {87986165-b0a9-4799-965f-eab6774f77c0} <Error> executeQuery: Code: 36. DB::Exception: Arguments `user` and `password` should be string literals (in single quotes). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: SELECT * FROM remote('127.0.0.1', system.one, default, '[HIDDEN]')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7e07 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.308531 [ 2567 ] {} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/, errno: 2, strerror: No such file or directory. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.308578 [ 22340 ] {80e9526d-daf1-4696-be19-8692d9c49298} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 8388944 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::NativeReader::readData(DB::ISerialization const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, DB::ReadBuffer&, unsigned long, double) @ 0x000000003e1645b4 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::NativeReader::read() @ 0x000000003e168bf5 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x000000003e0e55ba in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:1477: DB::TCPHandler::receivePacket() @ 0x000000003e0bf8b6 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x000000003e0c8382 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x000000003e0c1a96 in /usr/bin/clickhouse
18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8617 in /usr/bin/clickhouse
19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
23. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
25. ? @ 0x00007fea4cb39ac3 in ?
26. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.310631 [ 2386 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.311053 [ 22333 ] {} <Error> TCPHandler: Code: 101. DB::NetException: Unexpected packet Hello received from client. (UNEXPECTED_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::NetException::NetException<char const (&) [45]>(int, char const (&) [45]) @ 0x000000003e0f68b6 in /usr/bin/clickhouse
3. ./build_docker/./src/Server/TCPHandler.cpp:1388: DB::TCPHandler::receiveUnexpectedHello() @ 0x000000003e0d8ba4 in /usr/bin/clickhouse
4. ./build_docker/./src/Server/TCPHandler.cpp:1443: DB::TCPHandler::receivePacket() @ 0x000000003e0bfcc4 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.312267 [ 2563 ] {} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_83_19/, errno: 2, strerror: No such file or directory. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.312312 [ 3992 ] {} <Error> TCPHandler: Code: 101. DB::NetException: Unexpected packet Hello received from client. (UNEXPECTED_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::NetException::NetException<char const (&) [45]>(int, char const (&) [45]) @ 0x000000003e0f68b6 in /usr/bin/clickhouse
3. ./build_docker/./src/Server/TCPHandler.cpp:1388: DB::TCPHandler::receiveUnexpectedHello() @ 0x000000003e0d8ba4 in /usr/bin/clickhouse
4. ./build_docker/./src/Server/TCPHandler.cpp:1443: DB::TCPHandler::receivePacket() @ 0x000000003e0bfcc4 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.312331 [ 3983 ] {} <Error> TCPHandler: Code: 101. DB::NetException: Unexpected packet Hello received from client. (UNEXPECTED_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::NetException::NetException<char const (&) [45]>(int, char const (&) [45]) @ 0x000000003e0f68b6 in /usr/bin/clickhouse
3. ./build_docker/./src/Server/TCPHandler.cpp:1388: DB::TCPHandler::receiveUnexpectedHello() @ 0x000000003e0d8ba4 in /usr/bin/clickhouse
4. ./build_docker/./src/Server/TCPHandler.cpp:1443: DB::TCPHandler::receivePacket() @ 0x000000003e0bfcc4 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.312361 [ 21629 ] {de50bffd-1bfa-4de9-a561-caff8bd290b7} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1441792 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ParsedParams.Key1): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_4_4_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 36610): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::SerializationNamed::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036f6f42c in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse

2024.09.24 02:40:51.313873 [ 22370 ] {59c2c5df-d573-43f7-a85a-9a3293b48ba5} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1124501 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.313989 [ 2567 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::lambda}: Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/, errno: 2, strerror: No such file or directory: While committing metadata operation #0. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.314011 [ 6601 ] {21b6289e-12e1-4f52-89ad-c183daea5a8f} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.314205 [ 2531 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x00000000373001e3 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x0000000037300034 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x00000000372e4e1d in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4d20 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:271: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000003730f415 in /usr/bin/clickhouse
21. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:279: DB::DiskObjectStorage::createHardLink(String const&, String const&) @ 0x000000003730f7f8 in /usr/bin/clickhouse
22. ./build_docker/./src/Disks/FakeDiskTransaction.h:135: DB::FakeDiskTransaction::createHardLink(String const&, String const&) @ 0x000000003728b851 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DataPartStorageOnDiskFull::createHardLinkFrom(DB::IDataPartStorage const&, String const&, String const&) @ 0x000000003cbcc728 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:0: DB::MutateSomePartColumnsTask::prepare() @ 0x000000003d6fe075 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1501: DB::MutateSomePartColumnsTask::executeStep() @ 0x000000003d6fc715 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x000000003d69f9b2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad5f1d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.955537 [ 4381 ] {} <Error> ServerErrorHandler: Code: 99. DB::Exception: Unknown packet 15001 from client. (UNKNOWN_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Server/TCPHandler.cpp:1475: DB::TCPHandler::receivePacket() @ 0x000000003e0bfe6b in /usr/bin/clickhouse
4. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.964268 [ 2563 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::lambda}: Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_83_19/, errno: 2, strerror: No such file or directory: While committing metadata operation #0. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.964388 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1123272 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/202409_1_77_18/ in table system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 8692): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.970642 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.978639 [ 3239 ] {87986165-b0a9-4799-965f-eab6774f77c0} <Error> TCPHandler: Code: 36. DB::Exception: Arguments `user` and `password` should be string literals (in single quotes). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7e07 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:51.980194 [ 2561 ] {} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/, errno: 2, strerror: No such file or directory. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.984216 [ 22348 ] {} <Error> ServerErrorHandler: Code: 99. DB::Exception: Unknown packet 15001 from client. (UNKNOWN_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Server/TCPHandler.cpp:1475: DB::TCPHandler::receivePacket() @ 0x000000003e0bfe6b in /usr/bin/clickhouse
4. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.988934 [ 3154 ] {} <Error> ServerErrorHandler: Code: 99. DB::Exception: Unknown packet 15001 from client. (UNKNOWN_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Server/TCPHandler.cpp:1475: DB::TCPHandler::receivePacket() @ 0x000000003e0bfe6b in /usr/bin/clickhouse
4. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.993818 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_75_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049812 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_71_71_0/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 130): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:51.997184 [ 22340 ] {} <Error> ServerErrorHandler: Code: 99. DB::Exception: Unknown packet 15001 from client. (UNKNOWN_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Server/TCPHandler.cpp:1475: DB::TCPHandler::receivePacket() @ 0x000000003e0bfe6b in /usr/bin/clickhouse
4. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a686e in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:52.021465 [ 2561 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::lambda}: Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/, errno: 2, strerror: No such file or directory: While committing metadata operation #0. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:52.789105 [ 2535 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1122510 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 24 with max_rows_to_read = 65409): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:53.903406 [ 2348 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:53.903471 [ 2335 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:53.903461 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5056437 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:53.903461 [ 22368 ] {31d6df5d-70f5-42ba-ab00-d9fa9a4d9a23} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43376) (comment: 01072_nullable_jit.sql) (in query: INSERT INTO foo VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:37: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11cab1 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:40:53.903467 [ 3239 ] {e44da8f7-26ea-4a90-a085-9aa3d28e2d5a} <Error> executeQuery: Code: 36. DB::Exception: Arguments `user` and `password` should be string literals (in single quotes). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: select * from remote('127.0.0.1', system.one, default, key1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7e07 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:40:55.722385 [ 2563 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Removing temporary directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/
2024.09.24 02:40:55.722524 [ 2563 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/
2024.09.24 02:40:55.967329 [ 2564 ] {} <Warning> system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70): Removing temporary directory /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_83_19/
2024.09.24 02:40:55.967481 [ 2564 ] {} <Warning> system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_83_19/
2024.09.24 02:40:56.443462 [ 2639 ] {} <Error> void DB::SystemLog<DB::QueryViewsLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryViewsLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 4200446 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryViewsLogElement>::flushImpl(std::vector<DB::QueryViewsLogElement, std::allocator<DB::QueryViewsLogElement>> const&, unsigned long) @ 0x000000003a454113 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryViewsLogElement>::savingThreadFunction() @ 0x000000003a4513e2 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryViewsLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryViewsLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c483a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:40:56.758717 [ 2558 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:40:56.758826 [ 2558 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:40:59.084752 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4194556 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66cdfe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:01.323987 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:01.324065 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4218878 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:02.580846 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5114845 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::savingThreadFunction() @ 0x000000003a42c002 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c45ea7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:02.581022 [ 3994 ] {1b8c3c2d-7b1b-4781-8cb7-2991988c8f9a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46678) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:03.856040 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4196087 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:0: DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x00000000208b106a in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.cpp:0: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x000000003b1bed08 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::IColumn, DB::ColumnString>::clone() const @ 0x000000003b1dcc02 in /usr/bin/clickhouse
10. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
11. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)::operator()(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) const @ 0x000000000a9cddbe in /usr/bin/clickhouse
12. void std::__function::__policy_invoker<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>::__call_impl<std::__function::__default_alloc_func<DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&), void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>>(std::__function::__policy_storage const*, COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) @ 0x000000000a9cdca9 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnUnique.h:117: DB::ColumnUnique<DB::ColumnString>::forEachSubcolumn(std::function<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>) @ 0x0000000036b3f258 in /usr/bin/clickhouse
14. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cda63 in /usr/bin/clickhouse
15. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)::operator()(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) const @ 0x000000000a9cddbe in /usr/bin/clickhouse
16. void std::__function::__policy_invoker<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>::__call_impl<std::__function::__default_alloc_func<DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&), void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>>(std::__function::__policy_storage const*, COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) @ 0x000000000a9cdca9 in /usr/bin/clickhouse
17. ./build_docker/./src/Columns/ColumnLowCardinality.h:176: DB::ColumnLowCardinality::forEachSubcolumn(std::function<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>) @ 0x000000003b12ef10 in /usr/bin/clickhouse
18. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cda63 in /usr/bin/clickhouse
19. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:04.530429 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 4198589 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:04.530908 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 84. DB::Exception: Directory /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/ already exists. (DIRECTORY_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:185: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc824d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:04.532127 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_75_2}: Code: 84. DB::Exception: Directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/ already exists. (DIRECTORY_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:185: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc824d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:06.366304 [ 3239 ] {e44da8f7-26ea-4a90-a085-9aa3d28e2d5a} <Error> TCPHandler: Code: 36. DB::Exception: Arguments `user` and `password` should be string literals (in single quotes). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7e07 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:06.366313 [ 2526 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Error> void DB::CachedOnDiskWriteBufferFromFile::cacheData(char *, size_t, bool): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1400895 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:0: DB::FileSegmentRangeWriter::write(char const*, unsigned long, unsigned long, DB::FileSegmentKind) @ 0x000000003586043f in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:257: DB::CachedOnDiskWriteBufferFromFile::cacheData(char*, unsigned long, bool) @ 0x0000000035864bd8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:217: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863e42 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
19. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
21. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
22. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:06.366511 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:06.366484 [ 22368 ] {31d6df5d-70f5-42ba-ab00-d9fa9a4d9a23} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:37: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11cab1 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:41:06.366774 [ 3987 ] {b96fbcd4-56c0-4ceb-985c-39d4ee3a5351} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46744) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:06.367030 [ 3101 ] {b7195888-f119-4c22-a980-a98b37330761} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46756) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:06.367190 [ 3186 ] {3da1b984-2516-474a-a385-26e912d9c551} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1049191 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:38028) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:41:06.367173 [ 3991 ] {13d7743b-f44f-41f9-b4f8-2fb00d1b266b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46780) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a984e in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f27dda in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:41:06.367365 [ 2939 ] {03a85e08-3bbf-4a92-ab27-ce59e4319d82} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46814) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:06.367103 [ 6603 ] {a3b6d84b-d6c5-430f-aefc-641f22d276e4} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46768) (comment: 02896_memory_accounting_for_user.sh) (in query: SELECT * FROM numbers_mt(1000000) FORMAT CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:06.367375 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:07.577541 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 4956117 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:07.577755 [ 3976 ] {b5da6fad-4951-4856-be2f-adfd64815f68} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1518114 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 271 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46820) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:41:09.588070 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 4194751 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c44aff in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:09.588130 [ 2535 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1122510 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 24 with max_rows_to_read = 65409): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:09.588591 [ 22312 ] {18b8dbfb-30aa-45ac-b342-0bc583c926c9} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1340262 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchEngineID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 22748): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46928) (comment: 00035_aggregate_keys128.sql) (in query: SELECT SearchEngineID AS k1, AdvEngineID AS k2, count() AS c FROM test.hits GROUP BY k1, k2 ORDER BY c DESC, k1, k2 LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:41:10.448569 [ 2905 ] {91a3c69a-3ddc-4e6b-b8dd-0d4ff6bf3295} <Error> executeQuery: Code: 57. DB::Exception: Table `test1601_detach_permanently_atomic`.`test_name_reuse` already exists (detached permanently). (TABLE_ALREADY_EXISTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47370) (comment: 01601_detach_permanently.sql) (in query: create table test1601_detach_permanently_atomic.test_name_reuse (number UInt64) engine=MergeTree order by tuple();), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:353: DB::DatabaseOnDisk::checkMetadataFilenameAvailabilityUnlocked(String const&) const @ 0x000000003709cf0a in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::DatabaseOnDisk::checkMetadataFilenameAvailability(String const&) const @ 0x000000003709c429 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f0d69 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:10.450405 [ 2905 ] {91a3c69a-3ddc-4e6b-b8dd-0d4ff6bf3295} <Error> TCPHandler: Code: 57. DB::Exception: Table `test1601_detach_permanently_atomic`.`test_name_reuse` already exists (detached permanently). (TABLE_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:353: DB::DatabaseOnDisk::checkMetadataFilenameAvailabilityUnlocked(String const&) const @ 0x000000003709cf0a in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::DatabaseOnDisk::checkMetadataFilenameAvailability(String const&) const @ 0x000000003709c429 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f0d69 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:10.490922 [ 3994 ] {1b8c3c2d-7b1b-4781-8cb7-2991988c8f9a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:10.531100 [ 2782 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.531520 [ 22279 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.534440 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 84. DB::Exception: Directory /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/tmp_merge_202409_1_83_19/ already exists. (DIRECTORY_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:185: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc824d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.540497 [ 22286 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.542833 [ 22297 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.543232 [ 22289 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.543610 [ 22300 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.546861 [ 2939 ] {03a85e08-3bbf-4a92-ab27-ce59e4319d82} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:10.546861 [ 3987 ] {b96fbcd4-56c0-4ceb-985c-39d4ee3a5351} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:10.547499 [ 6603 ] {a3b6d84b-d6c5-430f-aefc-641f22d276e4} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:10.550198 [ 22305 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.550788 [ 3182 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.551335 [ 3101 ] {b7195888-f119-4c22-a980-a98b37330761} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1204840 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing NumbersMt. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208bbfbb in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::(anonymous namespace)::NumbersMultiThreadedSource::generate() @ 0x0000000034b569f2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:10.551406 [ 3186 ] {3da1b984-2516-474a-a385-26e912d9c551} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1049191 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:41:10.554792 [ 3991 ] {13d7743b-f44f-41f9-b4f8-2fb00d1b266b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048608 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a984e in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f27dda in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:41:10.555200 [ 2118 ] {85a14ed6-e7cc-48a2-ae7c-699240c09ed7} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 19.00 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44892) (comment: 00145_aggregate_functions_statistics.sql) (in query: SELECT round(varSamp(ResolutionWidth), 6) FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:10.555452 [ 2407 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.555722 [ 3976 ] {b5da6fad-4951-4856-be2f-adfd64815f68} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1518114 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 271 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:41:10.555764 [ 2442 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.555817 [ 22312 ] {18b8dbfb-30aa-45ac-b342-0bc583c926c9} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1340262 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchEngineID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 22748): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:41:10.558891 [ 22313 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.613808 [ 22314 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.617856 [ 22309 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.618759 [ 22316 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.622841 [ 22325 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.627430 [ 22323 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.639833 [ 22332 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.663379 [ 22327 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:10.663883 [ 22337 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:11.876711 [ 2905 ] {1b251c4b-044a-4c7d-a5c9-df15e24a8d7c} <Error> executeQuery: Code: 60. DB::Exception: Table test1601_detach_permanently_atomic.test_name_reuse does not exist. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47370) (comment: 01601_detach_permanently.sql) (in query: DETACH table test1601_detach_permanently_atomic.test_name_reuse PERMANENTLY;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae69aa in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x0000000039647801 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x0000000039645727 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643b20 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:11.876747 [ 2118 ] {85a14ed6-e7cc-48a2-ae7c-699240c09ed7} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 19.00 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:11.876871 [ 3239 ] {39e84833-b5a1-474e-b287-2ac16113dd98} <Error> executeQuery: Code: 47. DB::Exception: Missing columns: 'key1' while processing query: 'key1', required columns: 'key1' 'key1'. (UNKNOWN_IDENTIFIER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: SELECT * FROM remote('127.0.0.1', system.one, 'default', '[HIDDEN]', key1)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1356: DB::TreeRewriter::analyze(std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::IStorage const>, std::shared_ptr<DB::StorageSnapshot> const&, bool, bool, bool, bool) const @ 0x000000003a70e97d in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageDistributed.cpp:218: DB::(anonymous namespace)::buildShardingKeyExpression(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, DB::NamesAndTypesList const&, bool) @ 0x000000003bb62ad0 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::StorageDistributed(DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&, String const&, String const&, DB::DistributedSettings const&, bool, std::shared_ptr<DB::Cluster>, std::shared_ptr<DB::IAST>) @ 0x000000003bb5d017 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageDistributed> std::allocate_shared[abi:v15000]<DB::StorageDistributed, std::allocator<DB::StorageDistributed>, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, String const&, String const&, String, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::IAST> const&, String, String, DB::DistributedSettings, bool, std::shared_ptr<DB::Cluster> const&, void>(std::allocator<DB::StorageDistributed> const&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, String const&, String const&, String&&, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::IAST> const&, String&&, String&&, DB::DistributedSettings&&, bool&&, std::shared_ptr<DB::Cluster> const&) @ 0x00000000349f41a7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionRemote::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x00000000349eb482 in /usr/bin/clickhouse
9. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:11.877691 [ 22338 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:11.877681 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:11.877685 [ 2459 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:11.950603 [ 22339 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:11.952357 [ 3239 ] {39e84833-b5a1-474e-b287-2ac16113dd98} <Error> TCPHandler: Code: 47. DB::Exception: Missing columns: 'key1' while processing query: 'key1', required columns: 'key1' 'key1'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000943d0db in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr<DB::IAST> const&, bool, bool) @ 0x000000003a6f2157 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1356: DB::TreeRewriter::analyze(std::shared_ptr<DB::IAST>&, DB::NamesAndTypesList const&, std::shared_ptr<DB::IStorage const>, std::shared_ptr<DB::StorageSnapshot> const&, bool, bool, bool, bool) const @ 0x000000003a70e97d in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageDistributed.cpp:218: DB::(anonymous namespace)::buildShardingKeyExpression(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, DB::NamesAndTypesList const&, bool) @ 0x000000003bb62ad0 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::StorageDistributed(DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::IAST> const&, String const&, String const&, DB::DistributedSettings const&, bool, std::shared_ptr<DB::Cluster>, std::shared_ptr<DB::IAST>) @ 0x000000003bb5d017 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageDistributed> std::allocate_shared[abi:v15000]<DB::StorageDistributed, std::allocator<DB::StorageDistributed>, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, String const&, String const&, String, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::IAST> const&, String, String, DB::DistributedSettings, bool, std::shared_ptr<DB::Cluster> const&, void>(std::allocator<DB::StorageDistributed> const&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, String const&, String const&, String&&, std::shared_ptr<DB::Context const>&, std::shared_ptr<DB::IAST> const&, String&&, String&&, DB::DistributedSettings&&, bool&&, std::shared_ptr<DB::Cluster> const&) @ 0x00000000349f41a7 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionRemote::executeImpl(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool) const @ 0x00000000349eb482 in /usr/bin/clickhouse
9. ./build_docker/./src/TableFunctions/ITableFunction.cpp:0: DB::ITableFunction::execute(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, DB::ColumnsDescription, bool, bool) const @ 0x0000000035317351 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378af4dd in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
25. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:11.958457 [ 2905 ] {1b251c4b-044a-4c7d-a5c9-df15e24a8d7c} <Error> TCPHandler: Code: 60. DB::Exception: Table test1601_detach_permanently_atomic.test_name_reuse does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae69aa in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x0000000039647801 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x0000000039645727 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643b20 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:11.967006 [ 22334 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:11.976398 [ 22341 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:11.981326 [ 22347 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:11.986025 [ 22342 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.009606 [ 22340 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.018673 [ 22366 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.019735 [ 22367 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.023719 [ 2905 ] {1dbf9ecb-f3cf-47ee-a938-a125ad1734d1} <Error> executeQuery: Code: 60. DB::Exception: Table test1601_detach_permanently_atomic.test_name_reuse does not exist. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47370) (comment: 01601_detach_permanently.sql) (in query: DETACH table test1601_detach_permanently_atomic.test_name_reuse;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae69aa in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x0000000039647801 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x0000000039645727 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643b20 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:12.025897 [ 22360 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.030357 [ 22333 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.031951 [ 2905 ] {1dbf9ecb-f3cf-47ee-a938-a125ad1734d1} <Error> TCPHandler: Code: 60. DB::Exception: Table test1601_detach_permanently_atomic.test_name_reuse does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae69aa in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x0000000039647801 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x0000000039645727 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643b20 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:12.034878 [ 3154 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.036665 [ 22315 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.041318 [ 3232 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.042921 [ 3239 ] {04b16493-fb4d-4b0d-a6c3-ee49e3dc486d} <Error> executeQuery: Code: 36. DB::Exception: Arguments `user` and `password` should be string literals (in single quotes). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: SELECT * FROM remote('127.0.0.1', system.one, default, '[HIDDEN]', key1)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7e07 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:12.057960 [ 22322 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.062187 [ 3239 ] {04b16493-fb4d-4b0d-a6c3-ee49e3dc486d} <Error> TCPHandler: Code: 36. DB::Exception: Arguments `user` and `password` should be string literals (in single quotes). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7e07 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:12.062296 [ 3989 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.065975 [ 3983 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.082255 [ 22324 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.100224 [ 22353 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.103580 [ 3992 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.115087 [ 22358 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.125425 [ 22369 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.128183 [ 22326 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.130739 [ 22370 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.133172 [ 3990 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.137941 [ 21629 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.143133 [ 22363 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.143150 [ 2534 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1231838 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column value): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 6496): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.148865 [ 22322 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.152505 [ 3239 ] {18d3c9ef-004d-418c-a45a-047e825030e3} <Error> executeQuery: Code: 36. DB::Exception: Arguments `user` and `password` should be string literals (in single quotes). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: select * from remote('127.0.0.1', system.one, 'default', pwd, key1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7e07 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:12.153550 [ 6601 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:12.167773 [ 2534 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4 (to which part must be renamed before removing) already exists. Most likely this is due to unclean restart or race condition. Removing it.
2024.09.24 02:41:12.168207 [ 22351 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:13.171351 [ 3239 ] {18d3c9ef-004d-418c-a45a-047e825030e3} <Error> TCPHandler: Code: 36. DB::Exception: Arguments `user` and `password` should be string literals (in single quotes). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [77]>(int, char const (&) [77]) @ 0x000000000ae093d7 in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7e07 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:13.171414 [ 4381 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:13.171384 [ 22337 ] {5bb18b76-6905-41ab-ae05-5abe03b5ac59} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 24.00 MiB (attempt to allocate chunk of 1048608 bytes), maximum: 9.31 GiB: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44944) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a984e in /usr/bin/clickhouse
8. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
9. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f27dda in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:13.171486 [ 2534 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:13.171655 [ 2905 ] {f8a65ff5-a7b7-4b1c-bd42-be9204cf5c9a} <Error> executeQuery: Code: 60. DB::Exception: Table test1601_detach_permanently_atomic.test_name_reuse does not exist. (UNKNOWN_TABLE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47370) (comment: 01601_detach_permanently.sql) (in query: drop table test1601_detach_permanently_atomic.test_name_reuse;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae69aa in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x0000000039647801 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x0000000039645727 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643b20 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:13.172361 [ 2534 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Cannot recursively remove directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4. Exception: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:13.655457 [ 2564 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Removing temporary directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:41:13.655559 [ 2564 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:41:15.367329 [ 2354 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:15.367335 [ 22323 ] {bcb987d1-2054-4226-8c9b-e29d027c4810} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1310975 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44924) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:15.367331 [ 2400 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:15.367489 [ 22278 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:15.367548 [ 2905 ] {f8a65ff5-a7b7-4b1c-bd42-be9204cf5c9a} <Error> TCPHandler: Code: 60. DB::Exception: Table test1601_detach_permanently_atomic.test_name_reuse does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201a5c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae69aa in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x0000000039647801 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x0000000039645727 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643b20 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:15.367618 [ 2534 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> void DB::IMergeTreeDataPart::removeIfNeeded(): while removing part all_1_1_1_4 with path store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x00000000373001e3 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:341: DB::UnlinkMetadataFileOperation::undo() @ 0x0000000037303daf in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x00000000372e4e1d in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4d20 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:18.154476 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:18.154649 [ 22337 ] {5bb18b76-6905-41ab-ae05-5abe03b5ac59} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 24.00 MiB (attempt to allocate chunk of 1048608 bytes), maximum: 9.31 GiB: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a984e in /usr/bin/clickhouse
8. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
9. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f27dda in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:18.521135 [ 2559 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Removing temporary directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/
2024.09.24 02:41:18.521288 [ 2559 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_75_2/
2024.09.24 02:41:19.631343 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4194501 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:0: DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x00000000208b106a in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.cpp:0: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x000000003b1bed08 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::IColumn, DB::ColumnString>::clone() const @ 0x000000003b1dcc02 in /usr/bin/clickhouse
10. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
11. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)::operator()(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) const @ 0x000000000a9cddbe in /usr/bin/clickhouse
12. void std::__function::__policy_invoker<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>::__call_impl<std::__function::__default_alloc_func<DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&), void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>>(std::__function::__policy_storage const*, COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) @ 0x000000000a9cdca9 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::ColumnTuple::forEachSubcolumn(std::function<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>) @ 0x000000003b2543ad in /usr/bin/clickhouse
14. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cda63 in /usr/bin/clickhouse
15. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)::operator()(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) const @ 0x000000000a9cddbe in /usr/bin/clickhouse
16. void std::__function::__policy_invoker<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>::__call_impl<std::__function::__default_alloc_func<DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&), void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>>(std::__function::__policy_storage const*, COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) @ 0x000000000a9cdca9 in /usr/bin/clickhouse
17. ./build_docker/./src/Columns/ColumnArray.h:158: DB::ColumnArray::forEachSubcolumn(std::function<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>) @ 0x000000003acf1d64 in /usr/bin/clickhouse
18. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cda63 in /usr/bin/clickhouse
19. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)::operator()(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) const @ 0x000000000a9cddbe in /usr/bin/clickhouse
20. void std::__function::__policy_invoker<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>::__call_impl<std::__function::__default_alloc_func<DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>)::'lambda'(COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&), void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>>(std::__function::__policy_storage const*, COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&) @ 0x000000000a9cdca9 in /usr/bin/clickhouse
21. ./build_docker/./src/Columns/ColumnMap.cpp:279: DB::ColumnMap::forEachSubcolumn(std::function<void (COW<DB::IColumn>::chameleon_ptr<DB::IColumn>&)>) @ 0x000000003b13d8b1 in /usr/bin/clickhouse
22. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cda63 in /usr/bin/clickhouse
23. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:19.631518 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 5046229 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:19.631675 [ 22321 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:19.631780 [ 2534 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1231838 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column value): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 6496): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:0: DB::PartMergerWriter::mutateOriginalPartAndPrepareProjections() @ 0x000000003d698617 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:19.631990 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1123272 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/202409_1_77_18/ in table system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 8692): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.199689 [ 2535 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.754909 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:281: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66bd97 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.755008 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 4722910 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.755040 [ 22323 ] {bcb987d1-2054-4226-8c9b-e29d027c4810} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1310975 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:20.755168 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.755236 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4218366 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.754914 [ 3239 ] {8f458ce4-e0db-4001-a5b0-d866d499da79} <Error> executeQuery: Code: 42. DB::Exception: Table function 'remote' requires from 1 to 6 parameters: <addresses pattern> [, <name of remote database>, <name of remote table>] [, username[, password], sharding_key]. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: SELECT * FROM remote('127.0.0.1', system.one, 'default', '[HIDDEN]', key1, key2)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(PreformattedMessage const&, int) @ 0x00000000349ef33b in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7bec in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:20.755455 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4196413 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.755240 [ 2443 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.755997 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1107341 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_120_120_0/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 457): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.755476 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4207102 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:167: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000003700474d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.756503 [ 3139 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.756588 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 8609855 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.756639 [ 22322 ] {8f45cff2-4da8-4d85-9a14-6af94fb2637b} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 0.00 B (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44984) (comment: 00072_compare_date_and_string_index.sql) (in query: SELECT count() FROM test.hits WHERE EventDate > '2014-03-18';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:20.756616 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 4905957 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.756685 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_75_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1165672 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<unsigned long>::insert(DB::Field const&) @ 0x000000003b2cac89 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x000000003b24c1a0 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnArray.cpp:0: DB::ColumnArray::insert(DB::Field const&) @ 0x000000003ac9cd2d in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnMap.cpp:0: DB::ColumnMap::insert(DB::Field const&) @ 0x000000003b13b49a in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b8d0a23 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.757044 [ 2535 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.757071 [ 22685 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.757346 [ 3239 ] {8f458ce4-e0db-4001-a5b0-d866d499da79} <Error> TCPHandler: Code: 42. DB::Exception: Table function 'remote' requires from 1 to 6 parameters: <addresses pattern> [, <name of remote database>, <name of remote table>] [, username[, password], sharding_key]. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(PreformattedMessage const&, int) @ 0x00000000349ef33b in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7bec in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:20.769120 [ 22693 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.776828 [ 22694 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.779056 [ 3993 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.786619 [ 22705 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.790190 [ 22707 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.792269 [ 22708 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:20.794426 [ 22706 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:21.536179 [ 2538 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:22.425648 [ 3239 ] {169ea127-96df-49ef-99f8-6491cd7717cd} <Error> executeQuery: Code: 42. DB::Exception: Table function 'remote' requires from 1 to 6 parameters: <addresses pattern> [, <name of remote database>, <name of remote table>] [, username[, password], sharding_key]. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:53516) (comment: 02841_remote_parameter_parsing_error.sql) (in query: SELECT * FROM remote('127.0.0.1', system, one, 'default', '[HIDDEN]', key1, key2)), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(PreformattedMessage const&, int) @ 0x00000000349ef33b in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7b6d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:22.425771 [ 3987 ] {000cdc84-1391-46ff-9889-dc12ba5ef1c7} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column RegionID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 59 with max_rows_to_read = 81920): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33702) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT `RegionID`, uniqHLL12(`WatchID`) AS `X` FROM `test`.`hits` GROUP BY `RegionID` HAVING `X` > 100000 ORDER BY `RegionID` ASC), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:22.425825 [ 22709 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:22.425871 [ 3182 ] {cce54347-3b49-435c-9aaa-b26a41090012} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column RegionID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 59 with max_rows_to_read = 81920): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49272) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT `RegionID`, uniqHLL12(`WatchID`) AS `X` FROM `test`.`hits` GROUP BY `RegionID` HAVING `X` > 100000 ORDER BY `RegionID` ASC), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:22.856375 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmpe5f85d96-4b0a-4d8b-ba97-5280d69a8e56' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:41:23.719481 [ 22322 ] {8f45cff2-4da8-4d85-9a14-6af94fb2637b} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 0.00 B (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:23.719572 [ 2905 ] {b5adb28e-a3ac-49af-993e-0529fac7bf3a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47370) (comment: 01601_detach_permanently.sql) (in query: create table test1601_detach_permanently_atomic.test_name_rename_attempt (number UInt64) engine=MergeTree order by tuple();), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:41:23.719688 [ 22334 ] {33036927-36f2-4918-a745-d9a1edff96c0} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55608) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:41:23.719734 [ 22327 ] {ba654c76-2c1f-406b-aa54-4b39f00a896f} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44938) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:28.053856 [ 2585 ] {} <Error> void DB::SystemLog<DB::SessionLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4316646 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::SessionLogElement>::flushImpl(std::vector<DB::SessionLogElement, std::allocator<DB::SessionLogElement>> const&, unsigned long) @ 0x000000003a466b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::SessionLogElement>::savingThreadFunction() @ 0x000000003a463e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::SessionLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::SessionLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c49627 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.054179 [ 2356 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.054294 [ 2350 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.054322 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5008140 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.054381 [ 22710 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.054363 [ 2538 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.054595 [ 3239 ] {169ea127-96df-49ef-99f8-6491cd7717cd} <Error> TCPHandler: Code: 42. DB::Exception: Table function 'remote' requires from 1 to 6 parameters: <addresses pattern> [, <name of remote database>, <name of remote table>] [, username[, password], sharding_key]. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(PreformattedMessage const&, int) @ 0x00000000349ef33b in /usr/bin/clickhouse
3. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::parseArguments(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) @ 0x00000000349e7b6d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::TableFunctionFactory::get(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>) const @ 0x000000003532d466 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::executeTableFunction(std::shared_ptr<DB::IAST> const&, DB::ASTSelectQuery const*) @ 0x00000000378abd26 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:211: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6ad46 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:28.054693 [ 2905 ] {b5adb28e-a3ac-49af-993e-0529fac7bf3a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:41:28.054776 [ 22334 ] {33036927-36f2-4918-a745-d9a1edff96c0} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:41:28.054674 [ 3987 ] {000cdc84-1391-46ff-9889-dc12ba5ef1c7} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column RegionID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 59 with max_rows_to_read = 81920): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:28.054904 [ 22327 ] {ba654c76-2c1f-406b-aa54-4b39f00a896f} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:28.055012 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4800734 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.055128 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.055183 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1071660 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x00000000208bc5ec in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<unsigned long>>::clone() const @ 0x000000003b422c66 in /usr/bin/clickhouse
11. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
12. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.055228 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4956117 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.054513 [ 3182 ] {cce54347-3b49-435c-9aaa-b26a41090012} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column RegionID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 59 with max_rows_to_read = 81920): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:28.055119 [ 22337 ] {2df382c4-50b9-4fac-a0f7-7bb82d089b07} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55632) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:28.055286 [ 22704 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.062169 [ 22711 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.073490 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1110623 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.074027 [ 22712 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.082023 [ 22717 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.084554 [ 22713 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.090994 [ 22716 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.090987 [ 22332 ] {b789af42-525e-4625-a02f-2a9d146bccca} <Error> executeQuery: Code: 241. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column RegionID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 59 with max_rows_to_read = 81920): While executing MergeTreeThread. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:44952) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT RegionID, uniqHLL12(WatchID) AS X FROM remote('127.0.0.{1,2}', test, hits) GROUP BY RegionID HAVING X > 100000 ORDER BY RegionID ASC;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:41:28.101645 [ 22718 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.103175 [ 22719 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.108806 [ 22720 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.111359 [ 22721 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.115356 [ 22722 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.122823 [ 22723 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.125587 [ 22725 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.132188 [ 22724 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.132912 [ 22728 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.138992 [ 22729 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.140238 [ 22726 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.142899 [ 22732 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.146084 [ 22734 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.148359 [ 22735 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.149878 [ 22727 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.154789 [ 22736 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.159258 [ 22739 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.162547 [ 22738 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.164501 [ 22737 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.167036 [ 22740 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.169573 [ 22742 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.172260 [ 22741 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.176058 [ 22743 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.184485 [ 22744 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.187861 [ 22745 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.187895 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.192110 [ 22332 ] {b789af42-525e-4625-a02f-2a9d146bccca} <Error> TCPHandler: Code: 241. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column RegionID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 59 with max_rows_to_read = 81920): While executing MergeTreeThread. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:41:28.200404 [ 22749 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.223656 [ 22746 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.225653 [ 22751 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.226071 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_76_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1326367 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.229066 [ 22748 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.232388 [ 22752 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.239767 [ 22733 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.245126 [ 22753 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.351385 [ 22747 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.359114 [ 22750 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.362399 [ 22754 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.368286 [ 22348 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.370739 [ 22335 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.372029 [ 2950 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.373480 [ 2759 ] {} <Error> ServerErrorHandler: Code: 81. DB::Exception: Database test_u3wsnsd5 does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:509: DB::DatabaseCatalog::assertDatabaseExists(String const&) const @ 0x0000000037ad8d4b in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/Context.cpp:0: DB::Context::setCurrentDatabase(String const&) @ 0x000000003789aa51 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TCPHandler::runImpl() @ 0x000000003e0a5ccc in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.377046 [ 22324 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.386909 [ 22326 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.390231 [ 22333 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.491305 [ 22351 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.491503 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.495045 [ 22370 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.498336 [ 22340 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.498886 [ 22338 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.499339 [ 22339 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:28.500222 [ 22341 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:29.064116 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:29.068023 [ 2332 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:30.075051 [ 2346 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:30.085410 [ 2419 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:30.231012 [ 2529 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:31.954635 [ 22337 ] {2df382c4-50b9-4fac-a0f7-7bb82d089b07} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:31.955141 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:32.747619 [ 2526 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp80d944c7-406a-4af5-baef-d2c3dcd7f6ba' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:41:33.899558 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 4194556 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:33.899765 [ 2369 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:33.899841 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:33.899864 [ 2529 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:33.900261 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1195330 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_117_4/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8693): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:33.900304 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ea37678b-8afe-4455-ab95-2e8eb662fcd1::202409_1_79_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:37: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11cab1 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:33.900315 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 4767966 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:33.900521 [ 22334 ] {1eb44515-1860-4bb4-8a49-6df58e9fb55a} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34748) (comment: 00081_group_by_without_key_and_totals.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:33.908678 [ 22334 ] {1eb44515-1860-4bb4-8a49-6df58e9fb55a} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:34.881559 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:35.379760 [ 22333 ] {defe0f43-7fd6-413a-945a-75258519a5ff} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1233471 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:47314) (comment: 00223_shard_distributed_aggregation_memory_efficient.sql) (in query: SELECT count() AS `c` FROM `test_1`.`numbers_10_00223` WHERE `number` < if(randConstant() % 2, 5, 10) GROUP BY `number`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:35.379917 [ 22323 ] {bab24602-ae1c-4421-b966-a29e46e99324} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:55624) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:35.379911 [ 22324 ] {a8516718-598e-4a0b-b517-f074c7da411f} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34664) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:35.379944 [ 22348 ] {eb54d45b-12e3-46fb-b286-5c1ff90070ef} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34704) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:41:35.380045 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:35.380136 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1123272 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/202409_1_77_18/ in table system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 8692): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:35.380316 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_76_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1326367 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.670956 [ 22326 ] {59438d09-5d3a-43e3-82a2-55b61aec4982} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1527801 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION arrayElement(ProfileEvents :: 3, 'AggregationPreallocatedElementsInHashTables' :: 6) -> arrayElement(ProfileEvents, 'AggregationPreallocatedElementsInHashTables') UInt64 : 5': While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34736) (comment: 02151_hash_table_sizes_stats.sh) (in query: SELECT COUNT(*) FROM system.query_log WHERE (event_date >= yesterday()) AND (query_id = 'test_15_hash_table_sizes_stats_71241283') AND (current_database = currentDatabase()) AND (((ProfileEvents['AggregationPreallocatedElementsInHashTables']) >= 200001) AND ((ProfileEvents['AggregationPreallocatedElementsInHashTables']) <= 5000025))), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.cpp:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnString::indexImpl<char8_t>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b1e3e44 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnsCommon.h:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::selectIndexImpl<DB::ColumnString>(DB::ColumnString const&, DB::IColumn const&, unsigned long) @ 0x000000003b1c7617 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnString.cpp:267: DB::ColumnString::index(DB::IColumn const&, unsigned long) const @ 0x000000003b1c264e in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnLowCardinality.h:0: DB::recursiveRemoveLowCardinality(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x0000000036d4b206 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/DataTypeLowCardinalityHelpers.cpp:0: DB::recursiveRemoveLowCardinality(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x0000000036d4aab1 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:183: DB::recursiveRemoveLowCardinality(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x0000000036d49f68 in /usr/bin/clickhouse
16. ./build_docker/./src/DataTypes/DataTypeLowCardinalityHelpers.cpp:0: DB::recursiveRemoveLowCardinality(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x0000000036d4a7bc in /usr/bin/clickhouse
17. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::(anonymous namespace)::convertLowCardinalityColumnsToFull(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&) @ 0x00000000352c6d34 in /usr/bin/clickhouse
18. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c20c7 in /usr/bin/clickhouse
19. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::ExpressionActions::execute(DB::Block&, bool) const @ 0x0000000037c5dbc3 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x000000003d52badf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1074: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d524de4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse

2024.09.24 02:41:36.671024 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.671123 [ 2343 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.671222 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4956117 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.671015 [ 22327 ] {973bb43b-3574-4ab6-84cd-c9f3ea86484e} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34716) (comment: 00174_distinct_in_order.sql) (in query: CREATE TABLE distinct_in_order (`CounterID` UInt32, `EventDate` Date) ENGINE = MergeTree ORDER BY (CounterID, EventDate) SETTINGS index_granularity = 8192, index_granularity_bytes = '10Mi', min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0.770485520362854, merge_max_block_size = 20808, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 16956, primary_key_compress_block_size = 66388), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:41:36.671383 [ 22333 ] {defe0f43-7fd6-413a-945a-75258519a5ff} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1233471 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:36.671386 [ 22348 ] {eb54d45b-12e3-46fb-b286-5c1ff90070ef} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:41:36.671656 [ 22322 ] {4e52beda-c160-4029-876c-32064fd7870e} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1703999 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34662) (comment: 00223_shard_distributed_aggregation_memory_efficient.sql) (in query: SELECT sum(c = 1) IN (0, 5), sum(c = 2) IN (5, 10) FROM (SELECT number, count() AS c FROM remote('127.0.0.{2,3}', currentDatabase(), numbers_10_00223) WHERE number < (randConstant() % 2 ? 5 : 10) GROUP BY number);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::ReadBufferFromPocoSocket> std::make_shared[abi:v15000]<DB::ReadBufferFromPocoSocket, Poco::Net::StreamSocket&, void>(Poco::Net::StreamSocket&) @ 0x0000000039451c7f in /usr/bin/clickhouse
12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000003dd6c1b5 in /usr/bin/clickhouse
13. ./build_docker/./src/Client/Connection.cpp:435: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000003dd76efe in /usr/bin/clickhouse
14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:0: DB::ConnectionEstablisher::run(PoolWithFailoverBase<DB::IConnectionPool>::TryResult&, String&) @ 0x000000003ddd3b17 in /usr/bin/clickhouse
15. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003ddd7f7c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:41:36.671062 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.671962 [ 22324 ] {a8516718-598e-4a0b-b517-f074c7da411f} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:36.672146 [ 22332 ] {c484b3f4-8ea0-484e-b002-1baf742f1378} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform: While processing (SELECT count() FROM test_15.src_table) AS cnt: while pushing to view test_15.dst_mv (debe2c26-a9fe-4d1a-9276-f7499d3c2745). (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34720) (comment: 01268_mv_scalars.sql) (in query: insert into src_table select * from numbers(2);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:36.673434 [ 22334 ] {f508b0d3-fc31-4ab2-8500-61009eaf5eb2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1050606 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60006) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:36.674463 [ 22323 ] {bab24602-ae1c-4421-b966-a29e46e99324} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:36.674816 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.676380 [ 22327 ] {973bb43b-3574-4ab6-84cd-c9f3ea86484e} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:41:36.676753 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1110623 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.691315 [ 22332 ] {c484b3f4-8ea0-484e-b002-1baf742f1378} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform: While processing (SELECT count() FROM test_15.src_table) AS cnt: while pushing to view test_15.dst_mv (debe2c26-a9fe-4d1a-9276-f7499d3c2745). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:36.698491 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1144385 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/202409_1_77_18/ in table system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 8390): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.705113 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ea37678b-8afe-4455-ab95-2e8eb662fcd1::202409_1_79_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.708484 [ 22333 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:47314). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:36.708503 [ 22326 ] {59438d09-5d3a-43e3-82a2-55b61aec4982} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1527801 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION arrayElement(ProfileEvents :: 3, 'AggregationPreallocatedElementsInHashTables' :: 6) -> arrayElement(ProfileEvents, 'AggregationPreallocatedElementsInHashTables') UInt64 : 5': While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.cpp:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnString::indexImpl<char8_t>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b1e3e44 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnsCommon.h:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::selectIndexImpl<DB::ColumnString>(DB::ColumnString const&, DB::IColumn const&, unsigned long) @ 0x000000003b1c7617 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnString.cpp:267: DB::ColumnString::index(DB::IColumn const&, unsigned long) const @ 0x000000003b1c264e in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnLowCardinality.h:0: DB::recursiveRemoveLowCardinality(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x0000000036d4b206 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/DataTypeLowCardinalityHelpers.cpp:0: DB::recursiveRemoveLowCardinality(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x0000000036d4aab1 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:183: DB::recursiveRemoveLowCardinality(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x0000000036d49f68 in /usr/bin/clickhouse
16. ./build_docker/./src/DataTypes/DataTypeLowCardinalityHelpers.cpp:0: DB::recursiveRemoveLowCardinality(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x0000000036d4a7bc in /usr/bin/clickhouse
17. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::(anonymous namespace)::convertLowCardinalityColumnsToFull(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>&) @ 0x00000000352c6d34 in /usr/bin/clickhouse
18. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c20c7 in /usr/bin/clickhouse
19. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::ExpressionActions::execute(DB::Block&, bool) const @ 0x0000000037c5dbc3 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x000000003d52badf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1074: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d524de4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse

2024.09.24 02:41:36.715687 [ 22322 ] {4e52beda-c160-4029-876c-32064fd7870e} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1703999 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::ReadBufferFromPocoSocket> std::make_shared[abi:v15000]<DB::ReadBufferFromPocoSocket, Poco::Net::StreamSocket&, void>(Poco::Net::StreamSocket&) @ 0x0000000039451c7f in /usr/bin/clickhouse
12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000003dd6c1b5 in /usr/bin/clickhouse
13. ./build_docker/./src/Client/Connection.cpp:435: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000003dd76efe in /usr/bin/clickhouse
14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:0: DB::ConnectionEstablisher::run(PoolWithFailoverBase<DB::IConnectionPool>::TryResult&, String&) @ 0x000000003ddd3b17 in /usr/bin/clickhouse
15. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003ddd7f7c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:41:36.960503 [ 22334 ] {f508b0d3-fc31-4ab2-8500-61009eaf5eb2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1050606 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:37.671966 [ 2381 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:37.690256 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:38.317648 [ 22342 ] {c08c2078-fbd0-472e-9e89-f312cfbc4543} <Error> executeQuery: Code: 42. DB::Exception: Function arrayPartialSort needs at least 2 arguments, passed 1: While processing arrayPartialSort([1, 2, 3]). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60008) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialSort([1,2,3]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, unsigned long&, char const*, unsigned long>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<char const*>::type, std::type_identity<unsigned long>::type>, String&&, unsigned long&, char const*&&, unsigned long&&) @ 0x000000001db0e147 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db7755f in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:41:38.325555 [ 22342 ] {c08c2078-fbd0-472e-9e89-f312cfbc4543} <Error> TCPHandler: Code: 42. DB::Exception: Function arrayPartialSort needs at least 2 arguments, passed 1: While processing arrayPartialSort([1, 2, 3]). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, unsigned long&, char const*, unsigned long>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<char const*>::type, std::type_identity<unsigned long>::type>, String&&, unsigned long&, char const*&&, unsigned long&&) @ 0x000000001db0e147 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db7755f in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:41:38.422753 [ 22342 ] {6d774349-f274-482a-94a6-45e6c216851c} <Error> executeQuery: Code: 43. DB::Exception: First argument for function arrayPartialSort must be a function. Actual UInt8: While processing arrayPartialSort(2, [1, 2, 3], [1]). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60008) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialSort(2, [1,2,3], [1]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db77a6e in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:41:38.438849 [ 22342 ] {6d774349-f274-482a-94a6-45e6c216851c} <Error> TCPHandler: Code: 43. DB::Exception: First argument for function arrayPartialSort must be a function. Actual UInt8: While processing arrayPartialSort(2, [1, 2, 3], [1]). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db77a6e in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:41:38.613765 [ 22342 ] {0d7f5e00-70bf-4caf-8d94-163a99be9a2a} <Error> executeQuery: Code: 43. DB::Exception: First argument for function arrayPartialSort must be a function. Actual UInt8: While processing arrayPartialSort(2, [1, 2, 3], 3). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60008) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialSort(2, [1,2,3], 3);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db77a6e in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:41:38.623010 [ 22342 ] {0d7f5e00-70bf-4caf-8d94-163a99be9a2a} <Error> TCPHandler: Code: 43. DB::Exception: First argument for function arrayPartialSort must be a function. Actual UInt8: While processing arrayPartialSort(2, [1, 2, 3], 3). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db77a6e in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:41:38.675641 [ 2422 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:38.680645 [ 22342 ] {649537b1-b787-4003-9f03-dba0256ca201} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Array(UInt8) of limit argument of function arrayPartialSort (must be UInt or Int): While processing arrayPartialSort(arraySort([1, 2, 3]), [1, 2, 3]). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60008) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialSort(arraySort([1,2,3]), [1,2,3]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<true, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db7b8d4 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db76359 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:41:38.689239 [ 22342 ] {649537b1-b787-4003-9f03-dba0256ca201} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Array(UInt8) of limit argument of function arrayPartialSort (must be UInt or Int): While processing arrayPartialSort(arraySort([1, 2, 3]), [1, 2, 3]). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<true, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db7b8d4 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db76359 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:41:38.702232 [ 2367 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:38.795531 [ 22342 ] {e859f2c0-0d93-4caf-a276-0207536510ee} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Array(Array(UInt8)) of limit argument of function arrayPartialSort (must be UInt or Int): While processing arrayMap(x -> range(x), [4, 1, 2, 3]) AS arr, 100 AS lim, arrayResize(arrayPartialSort(arrayPartialSort(lim, arr), arr), lim), arrayResize(arrayPartialReverseSort(lim, arr), lim), arrayResize(arrayPartialSort(x -> (-length(x)), lim, arr), lim). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60008) (comment: 00390_array_sort.sql) (in query: SELECT arrayMap(x -> range(x), [4, 1, 2, 3]) AS arr, 100 AS lim, arrayResize(arrayPartialSort(arrayPartialSort(lim, arr), arr), lim), arrayResize(arrayPartialReverseSort(lim, arr), lim), arrayResize(arrayPartialSort(x -> (-length(x)), lim, arr), lim);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<true, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db7b8d4 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db76359 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse

2024.09.24 02:41:38.803961 [ 22342 ] {e859f2c0-0d93-4caf-a276-0207536510ee} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Array(Array(UInt8)) of limit argument of function arrayPartialSort (must be UInt or Int): While processing arrayMap(x -> range(x), [4, 1, 2, 3]) AS arr, 100 AS lim, arrayResize(arrayPartialSort(arrayPartialSort(lim, arr), arr), lim), arrayResize(arrayPartialReverseSort(lim, arr), lim), arrayResize(arrayPartialSort(x -> (-length(x)), lim, arr), lim). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<true, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db7b8d4 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<true, true>, DB::NameArrayPartialSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db76359 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d51ed1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse

2024.09.24 02:41:42.502517 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ff416 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:271: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000003730f415 in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:279: DB::DiskObjectStorage::createHardLink(String const&, String const&) @ 0x000000003730f7f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Disks/FakeDiskTransaction.h:135: DB::FakeDiskTransaction::createHardLink(String const&, String const&) @ 0x000000003728b851 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DataPartStorageOnDiskFull::createHardLinkFrom(DB::IDataPartStorage const&, String const&, String const&) @ 0x000000003cbcc728 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:0: DB::MutateSomePartColumnsTask::prepare() @ 0x000000003d6fe075 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1501: DB::MutateSomePartColumnsTask::executeStep() @ 0x000000003d6fc715 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x000000003d69f9b2 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad5f1d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:42.502787 [ 22342 ] {1cb0c466-fb68-48ad-b8cf-ef2985971b82} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Array(Nullable(Nothing)) of limit argument of function arrayPartialReverseSort (must be UInt or Int): While processing arrayPartialReverseSort(arraySort((x, y) -> y, [NULL, NULL], [NULL, NULL]), arrayMap(x -> toString(x), [257, -9223372036854775807, 2, -2147483648, 2147483648, NULL, 65536, -2147483648, 2, 65535]) AS arr), arr, NULL, 100 AS lim, 65536, arrayResize(arrayPartialSort(x -> reverse(x), lim, arr), lim). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60008) (comment: 00390_array_sort.sql) (in query: SELECT arrayPartialReverseSort(arraySort((x, y) -> y, [NULL, NULL], [NULL, NULL]), arr), arrayMap(x -> toString(x), [257, -9223372036854775807, 2, -2147483648, 2147483648, NULL, 65536, -2147483648, 2, 65535]) AS arr, NULL, 100 AS lim, 65536, arrayResize(arrayPartialSort(x -> reverse(x), lim, arr), lim) GROUP BY [NULL, 1023, -2, NULL, 255, '0', NULL, 9223372036854775806] WITH ROLLUP;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<false, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db8cb74 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<false, true>, DB::NameArrayPartialReverseSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db875f9 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:41:42.502962 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4194556 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66cdfe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:42.502998 [ 22326 ] {69a5a92d-cf6c-4003-b91d-99b80a9e8814} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1068271 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60042) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:42.503678 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:45.545514 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:45.545518 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:50.171037 [ 22342 ] {1cb0c466-fb68-48ad-b8cf-ef2985971b82} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Array(Nullable(Nothing)) of limit argument of function arrayPartialReverseSort (must be UInt or Int): While processing arrayPartialReverseSort(arraySort((x, y) -> y, [NULL, NULL], [NULL, NULL]), arrayMap(x -> toString(x), [257, -9223372036854775807, 2, -2147483648, 2147483648, NULL, 65536, -2147483648, 2, 65535]) AS arr), arr, NULL, 100 AS lim, 65536, arrayResize(arrayPartialSort(x -> reverse(x), lim, arr), lim). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. DB::ArraySortImpl<false, true>::checkArguments(String const&, DB::ColumnWithTypeAndName const*) @ 0x000000001db8cb74 in /usr/bin/clickhouse
4. DB::FunctionArrayMapped<DB::ArraySortImpl<false, true>, DB::NameArrayPartialReverseSort>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000001db875f9 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:41:50.171227 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4 (to which part must be renamed before removing) already exists. Most likely this is due to unclean restart or race condition. Removing it.
2024.09.24 02:41:51.528986 [ 2560 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Removing temporary directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_76_2/
2024.09.24 02:41:51.529098 [ 2560 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_76_2/
2024.09.24 02:41:52.221764 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4210202 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:269: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66b425 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:52.221997 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1096285 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_6_6_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6826): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368aedff in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e673 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:52.221978 [ 22326 ] {69a5a92d-cf6c-4003-b91d-99b80a9e8814} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1068271 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:52.222037 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1093504 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_117_4/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 9076): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:53.598923 [ 2528 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp8a4a0d5b-d16d-401d-a875-c0243772d610' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:41:54.098876 [ 2558 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Removing temporary directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:41:54.098986 [ 2558 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/
2024.09.24 02:41:54.748765 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4194556 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66cdfe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:54.748999 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:54.749107 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:54.749121 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 2097215 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000003d124c95 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:422: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000003d1274e5 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d6640e7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:57.217915 [ 2561 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:41:57.218022 [ 2561 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:41:57.225382 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4280197 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.cpp:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b1e3604 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/ColumnString.cpp:212: DB::ColumnString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b1c2166 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPartWriter.cpp:0: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d135ce2 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:166: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11e92d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::savingThreadFunction() @ 0x000000003a42c002 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c45ea7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c45d7f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:57.899284 [ 22347 ] {4e087aab-ebf5-48d6-8846-31c3dc798470} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1769694 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: common/iju/hhoakvqbpldgwnkknxnligpucnjus, hash key: 367a0afe36db32dade3d0a2dbe38a5ff, file_offset_of_buffer_end: 1218905, read_until_position: 1243481, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4e087aab-ebf5-48d6-8846-31c3dc798470:18040, file segment info: File segment: [0, 1498902], key: 367a0afe36db32dade3d0a2dbe38a5ff, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 4e087aab-ebf5-48d6-8846-31c3dc798470:18040, current write offset: 0, caller id: 4e087aab-ebf5-48d6-8846-31c3dc798470:18040, kind: Regular, unbound: 0: (while reading column RefererCategories): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 285 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60020) (comment: 00061_storage_buffer.sql) (in query: INSERT INTO test.hits_buffer SELECT * FROM test.hits WHERE CounterID = 800784;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000003579aea6 in /usr/bin/clickhouse
20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a6245 in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CachedCompressedReadBuffer.cpp:0: DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003d4952d7 in /usr/bin/clickhouse
22. ./build_docker/./src/Compression/CachedCompressedReadBuffer.cpp:0: non-virtual thunk to DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003d496b0d in /usr/bin/clickhouse
23. DB::ReadBuffer::readBig(char*, unsigned long) @ 0x000000000a78701d in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned short>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f99490 in /usr/bin/clickhouse
25. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
26. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse

2024.09.24 02:41:59.202399 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 5143033 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:59.202463 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:41:59.202602 [ 22322 ] {b6d04860-2f9f-46e4-ba4a-a02061ffc1d2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1081472 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60028) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:0: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f27d7a in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:41:59.204600 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Cannot recursively remove directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4. Exception: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While committing metadata operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:00.221880 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:00.221997 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:00.222434 [ 22324 ] {58f2ff85-8d06-48af-af2e-d3f27face4f1} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1429751 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ParsedParams.Key1): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32884): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60036) (comment: 00079_array_join_not_used_joined_column.sql) (in query: SELECT PP.Key1 AS x1, ParsedParams.Key2 AS x2 FROM test.hits ARRAY JOIN ParsedParams AS PP WHERE CounterID = 1704509 ORDER BY x1, x2 LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:251: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed692d in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:42:01.494381 [ 22347 ] {4e087aab-ebf5-48d6-8846-31c3dc798470} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1769694 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: common/iju/hhoakvqbpldgwnkknxnligpucnjus, hash key: 367a0afe36db32dade3d0a2dbe38a5ff, file_offset_of_buffer_end: 1218905, read_until_position: 1243481, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4e087aab-ebf5-48d6-8846-31c3dc798470:18040, file segment info: File segment: [0, 1498902], key: 367a0afe36db32dade3d0a2dbe38a5ff, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 4e087aab-ebf5-48d6-8846-31c3dc798470:18040, current write offset: 0, caller id: 4e087aab-ebf5-48d6-8846-31c3dc798470:18040, kind: Regular, unbound: 0: (while reading column RefererCategories): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 285 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000003579aea6 in /usr/bin/clickhouse
20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a6245 in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CachedCompressedReadBuffer.cpp:0: DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003d4952d7 in /usr/bin/clickhouse
22. ./build_docker/./src/Compression/CachedCompressedReadBuffer.cpp:0: non-virtual thunk to DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003d496b0d in /usr/bin/clickhouse
23. DB::ReadBuffer::readBig(char*, unsigned long) @ 0x000000000a78701d in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned short>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f99490 in /usr/bin/clickhouse
25. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
26. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse

2024.09.24 02:42:01.494442 [ 2561 ] {} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/, errno: 2, strerror: No such file or directory. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:01.494784 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1049571 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435e51 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:322: DB::ColumnVector<long>::insertDefault() @ 0x000000003b354a15 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::ColumnSparse(COW<DB::IColumn>::mutable_ptr<DB::IColumn>&&) @ 0x000000003b1a1813 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::IDataType::createColumn(DB::ISerialization const&) const @ 0x0000000036dd5efa in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:140: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d473eda in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:01.494600 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> void DB::IMergeTreeDataPart::removeIfNeeded(): while removing part all_1_1_1_4 with path store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/tmp_mut_all_1_1_1_4/: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While committing metadata operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372ffb6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::UnlinkMetadataFileOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000373036d2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:0: DB::DataPartStorageOnDiskBase::remove(std::function<DB::CanRemoveDescription ()>&&, DB::MergeTreeDataPartChecksums const&, std::list<DB::IDataPartStorage::ProjectionChecksums, std::allocator<DB::IDataPartStorage::ProjectionChecksums>>, bool, Poco::Logger*) @ 0x000000003cc00fb3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:616: DB::IMergeTreeDataPart::remove() @ 0x000000003cc56757 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:0: DB::IMergeTreeDataPart::removeIfNeeded() @ 0x000000003cc52b3c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWide.cpp:173: DB::MergeTreeDataPartWide::~MergeTreeDataPartWide() @ 0x000000003d11246c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MergeTreeDataPartWide, std::allocator<DB::MergeTreeDataPartWide>>::__on_zero_shared() @ 0x000000003d0c8b61 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::MutationContext::~MutationContext() @ 0x000000003d6edfb3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutationContext, std::allocator<DB::MutationContext>>::__on_zero_shared() @ 0x000000003d6ed34d in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__destroy_at[abi:v15000]<DB::MutateTask, 0>(DB::MutateTask*) @ 0x000000003d0c1838 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:313: std::__shared_ptr_emplace<DB::MutateTask, std::allocator<DB::MutateTask>>::__on_zero_shared() @ 0x000000003d0c16cd in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: void std::__function::__policy_invoker<void (DB::ExecutionStatus const&)>::__call_impl<std::__function::__default_alloc_func<DB::MutatePlainMergeTreeTask::prepare()::$_0, void (DB::ExecutionStatus const&)>>(std::__function::__policy_storage const*, DB::ExecutionStatus const&) @ 0x000000003dad7f27 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad78e6 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:01.494710 [ 22322 ] {b6d04860-2f9f-46e4-ba4a-a02061ffc1d2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1081472 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:0: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f27d7a in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:01.494727 [ 22324 ] {58f2ff85-8d06-48af-af2e-d3f27face4f1} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1429751 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ParsedParams.Key1): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32884): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:251: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed692d in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:42:01.495042 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:01.494496 [ 22327 ] {7f49afe8-5c4b-47b3-ad2e-2eb2ef559a5a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1114271 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column URLCategories): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 50951): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43188) (comment: 00030_array_enumerate_uniq.sql) (in query: SELECT max(arrayJoin(arrayEnumerateUniq(arrayMap(x -> intDiv(x, 10), URLCategories)))) FROM test.hits ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:222: DB::(anonymous namespace)::arrayOffsetsToSizes(DB::IColumn const&) @ 0x0000000036ed8fa6 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036edd8f2 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:02.450340 [ 2564 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:42:02.450463 [ 2564 ] {} <Warning> system.metric_log (ac860a65-c7ac-46f7-9b65-d9351c8c648b): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/
2024.09.24 02:42:02.460134 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.460140 [ 2439 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.460142 [ 22334 ] {3f57aa82-8c27-4d45-b033-9bc705a18c0a} <Error> executeQuery: Code: 192. DB::Exception: There is no user `u2_01292` in user directories. (UNKNOWN_USER) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56336) (comment: 01292_create_user.sql) (in query: SHOW CREATE USER u2_01292;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/IAccessStorage.cpp:682: DB::IAccessStorage::throwNotFound(DB::AccessEntityType, String const&) const @ 0x0000000035c89b83 in /usr/bin/clickhouse
4. ./build_docker/./src/Access/IAccessStorage.cpp:0: DB::IAccessStorage::getID(DB::AccessEntityType, String const&) const @ 0x0000000035c89957 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Access/InterpreterShowCreateAccessEntityQuery.cpp:0: DB::InterpreterShowCreateAccessEntityQuery::getEntities() const @ 0x000000003ab91d84 in /usr/bin/clickhouse
6. ./build_docker/./contrib/abseil-cpp/absl/container/internal/compressed_tuple.h:108: DB::InterpreterShowCreateAccessEntityQuery::getCreateQueries() const @ 0x000000003ab8e76e in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Access/InterpreterShowCreateAccessEntityQuery.cpp:0: DB::InterpreterShowCreateAccessEntityQuery::executeImpl() @ 0x000000003ab8c401 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Access/InterpreterShowCreateAccessEntityQuery.cpp:0: DB::InterpreterShowCreateAccessEntityQuery::execute() @ 0x000000003ab8c2c4 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:02.460490 [ 2560 ] {} <Error> virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_76_2/, errno: 2, strerror: No such file or directory. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.460534 [ 2561 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::lambda}: Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/, errno: 2, strerror: No such file or directory: While committing metadata operation #0. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.460458 [ 22326 ] {46631450-0df0-4885-b320-b4a2d6fba507} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.69 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56332) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:02.460566 [ 2527 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x00000000373001e3 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x0000000037300034 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x00000000372e4e1d in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4d20 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:271: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000003730f415 in /usr/bin/clickhouse
21. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:279: DB::DiskObjectStorage::createHardLink(String const&, String const&) @ 0x000000003730f7f8 in /usr/bin/clickhouse
22. ./build_docker/./src/Disks/FakeDiskTransaction.h:135: DB::FakeDiskTransaction::createHardLink(String const&, String const&) @ 0x000000003728b851 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::DataPartStorageOnDiskFull::createHardLinkFrom(DB::IDataPartStorage const&, String const&, String const&) @ 0x000000003cbcc728 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:0: DB::MutateSomePartColumnsTask::prepare() @ 0x000000003d6fe075 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1501: DB::MutateSomePartColumnsTask::executeStep() @ 0x000000003d6fc715 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x000000003d69f9b2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:0: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003dad5f1d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.460670 [ 22327 ] {7f49afe8-5c4b-47b3-ad2e-2eb2ef559a5a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1114271 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column URLCategories): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 50951): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:222: DB::(anonymous namespace)::arrayOffsetsToSizes(DB::IColumn const&) @ 0x0000000036ed8fa6 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036edd8f2 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:02.461356 [ 2537 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp87ee5a22-b076-449a-9f85-7585a24866cf' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:42:02.461498 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 84. DB::Exception: Directory /var/lib/clickhouse/disks/s3/store/ac8/ac860a65-c7ac-46f7-9b65-d9351c8c648b/tmp_merge_202409_62_67_1/ already exists. (DIRECTORY_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:185: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc824d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.461578 [ 2560 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::lambda}: Code: 566. DB::ErrnoException: Cannot rmdir /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_76_2/, errno: 2, strerror: No such file or directory: While committing metadata operation #0. (CANNOT_RMDIR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:224: DB::throwFromErrnoWithPath(String const&, String const&, int, int) @ 0x000000002084fc42 in /usr/bin/clickhouse
4. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::removeDirectory(String const&) @ 0x000000003724ee1d in /usr/bin/clickhouse
5. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:130: DB::RemoveDirectoryOperation::execute(std::unique_lock<DB::SharedMutex>&) @ 0x00000000372fcf98 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x00000000372e4527 in /usr/bin/clickhouse
7. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000003737790b in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:411: DB::DiskObjectStorage::removeSharedRecursive(String const&, bool, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x00000000373188fb in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_set:615: DB::MergeTreeData::clearOldTemporaryDirectories(String const&, unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce92d8a in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:2050: DB::MergeTreeData::clearOldTemporaryDirectories(unsigned long, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&) @ 0x000000003ce8f84f in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/StorageMergeTree.cpp:1365: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageMergeTree::scheduleDataProcessingJob(DB::BackgroundJobsAssignee&)::$_0, bool ()>>(std::__function::__policy_storage const*) @ 0x000000003da91366 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x000000003c2fff17 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce1a6cb in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::threadFunction() @ 0x000000003ce1ce10 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::RoundRobinRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3421f in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
17. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.465203 [ 22334 ] {3f57aa82-8c27-4d45-b033-9bc705a18c0a} <Error> TCPHandler: Code: 192. DB::Exception: There is no user `u2_01292` in user directories. (UNKNOWN_USER), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000bf2f2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/IAccessStorage.cpp:682: DB::IAccessStorage::throwNotFound(DB::AccessEntityType, String const&) const @ 0x0000000035c89b83 in /usr/bin/clickhouse
4. ./build_docker/./src/Access/IAccessStorage.cpp:0: DB::IAccessStorage::getID(DB::AccessEntityType, String const&) const @ 0x0000000035c89957 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/Access/InterpreterShowCreateAccessEntityQuery.cpp:0: DB::InterpreterShowCreateAccessEntityQuery::getEntities() const @ 0x000000003ab91d84 in /usr/bin/clickhouse
6. ./build_docker/./contrib/abseil-cpp/absl/container/internal/compressed_tuple.h:108: DB::InterpreterShowCreateAccessEntityQuery::getCreateQueries() const @ 0x000000003ab8e76e in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Access/InterpreterShowCreateAccessEntityQuery.cpp:0: DB::InterpreterShowCreateAccessEntityQuery::executeImpl() @ 0x000000003ab8c401 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Access/InterpreterShowCreateAccessEntityQuery.cpp:0: DB::InterpreterShowCreateAccessEntityQuery::execute() @ 0x000000003ab8c2c4 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:02.467123 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.475784 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_76_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1106376 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<2ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000a81a78d in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<unsigned short>::insert(DB::Field const&) @ 0x000000003b296ac2 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::insert(DB::Field const&) @ 0x000000003b0dee12 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x000000003b24c1a0 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnArray.cpp:0: DB::ColumnArray::insert(DB::Field const&) @ 0x000000003ac9cd2d in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/ColumnMap.cpp:0: DB::ColumnMap::insert(DB::Field const&) @ 0x000000003b13b49a in /usr/bin/clickhouse
15. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b8d0a23 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:02.652512 [ 2534 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:03.927117 [ 22333 ] {aab128ac-abf9-4813-86e8-5fd7d53ec108} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1118460 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60106) (comment: 00926_zookeeper_adaptive_index_granularity_replicated_merge_tree_long.sql) (in query: INSERT INTO zero_rows_per_granule1 (p, k, v1, v2) VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000003d959631 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:42:05.262481 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 5172289 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:05.262540 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 5128001 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:05.262590 [ 22332 ] {5079a432-faa9-4818-bd92-107b82cc9220} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60096) (comment: 01045_bloom_filter_null_array.sql) (in query: INSERT INTO bloom_filter_null_array VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const*, String&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const*&&, String&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d15788b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:220: DB::MergeTreeDataPartWriterOnDisk::initSkipIndices() @ 0x000000003d148aa1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:129: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1462a6 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse

2024.09.24 02:42:05.262655 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 5173311 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:05.262725 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1103695 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:05.262802 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 4274104 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:05.262859 [ 22326 ] {46631450-0df0-4885-b320-b4a2d6fba507} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.69 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:05.262988 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1110623 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:05.363495 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4212226 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:07.046370 [ 2335 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:07.046433 [ 2348 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:07.046470 [ 22333 ] {aab128ac-abf9-4813-86e8-5fd7d53ec108} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1118460 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000003d959631 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:42:07.046495 [ 22335 ] {fb6fbb22-5c20-4a37-813c-ffb377dfb743} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 54.20 MiB (attempt to allocate chunk of 1195568 bytes), maximum: 9.31 GiB: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56370) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:42:08.419431 [ 2534 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1194542 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column id): (while reading from part /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/all_1_1_1_3/ in table test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1569): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504c31 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:08.419577 [ 22332 ] {5079a432-faa9-4818-bd92-107b82cc9220} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const*, String&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const*&&, String&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d15788b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:220: DB::MergeTreeDataPartWriterOnDisk::initSkipIndices() @ 0x000000003d148aa1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:129: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1462a6 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse

2024.09.24 02:42:08.419623 [ 22353 ] {a7a33aec-96e1-4442-ac69-2b778107de51} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 11.76 MiB (attempt to allocate chunk of 1298475 bytes), maximum: 9.31 GiB: (while reading column ResolutionWidth): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56380) (comment: 00164_quantileBfloat16.sql) (in query: SELECT CounterID AS k, quantileBFloat16(0.5)(ResolutionWidth) FROM test.hits GROUP BY k ORDER BY count() DESC, CounterID LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d527919 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:42:08.419686 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5128625 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:08.419842 [ 2526 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Error> void DB::CachedOnDiskWriteBufferFromFile::cacheData(char *, size_t, bool): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1400895 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:0: DB::FileSegmentRangeWriter::write(char const*, unsigned long, unsigned long, DB::FileSegmentKind) @ 0x000000003586043f in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:257: DB::CachedOnDiskWriteBufferFromFile::cacheData(char*, unsigned long, bool) @ 0x0000000035864bd8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:217: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863e42 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
19. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
21. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
22. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:08.420102 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:08.419841 [ 22335 ] {fb6fbb22-5c20-4a37-813c-ffb377dfb743} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 54.20 MiB (attempt to allocate chunk of 1195568 bytes), maximum: 9.31 GiB: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:42:08.419905 [ 2345 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:08.445339 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1123272 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/202409_1_77_18/ in table system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 8692): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:08.466070 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1411454 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:08.541619 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1093504 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_117_4/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 9076): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:08.572910 [ 2560 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Removing temporary directory /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_76_2/
2024.09.24 02:42:08.572991 [ 2560 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_merge_202409_55_76_2/
2024.09.24 02:42:09.096761 [ 22353 ] {a7a33aec-96e1-4442-ac69-2b778107de51} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 11.76 MiB (attempt to allocate chunk of 1298475 bytes), maximum: 9.31 GiB: (while reading column ResolutionWidth): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d527919 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:42:09.423604 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:09.424191 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:10.172011 [ 2529 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:13.289000 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 2359296 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_117_4/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 9021): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:13.289015 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 4347796 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:13.289184 [ 22342 ] {d4b76ea2-7263-4d95-ac46-348326c4300a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1091972 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 96.04667663574219, avg_chars_size = 105.65601196289062, limit = 4096): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 95 with max_rows_to_read = 4096): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43174) (comment: 00071_merge_tree_optimize_aio.sql) (in query: INSERT INTO test.hits_snippet(EventTime, EventDate, CounterID, UserID, URL, Referer) SELECT EventTime, EventDate, CounterID, UserID, URL, Referer FROM test.hits WHERE EventDate = toDate('2014-03-18') ORDER BY EventTime, EventDate, CounterID, UserID, URL, Referer ASC LIMIT 50;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:15.939850 [ 2412 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:15.940043 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.749418 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4253119 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.749418 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 5171009 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.749469 [ 22335 ] {7f176b34-61ee-424d-81dc-e09b06a26db6} <Error> executeQuery: Code: 43. DB::Exception: Second argument of function transform, must be array of source values to transform from.: While processing transform('hello', 'wrong', 1). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43206) (comment: 00153_transform.sql) (in query: SELECT transform('hello', 'wrong', 1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3aef44 in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:42:18.749580 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 5224534 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f47322 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.749661 [ 2529 ] {7b6dfa43-cc4c-4e1e-974f-b16e2490b692::all_1_1_1_4} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.749677 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 5150529 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.749957 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 5179745 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.750007 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_83_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.749939 [ 22342 ] {d4b76ea2-7263-4d95-ac46-348326c4300a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1091972 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 96.04667663574219, avg_chars_size = 105.65601196289062, limit = 4096): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 95 with max_rows_to_read = 4096): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:18.750101 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4198589 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.750274 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5128489 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.750359 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.750439 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.750529 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4504308 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.750605 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_77_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1097368 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:18.751399 [ 22335 ] {7f176b34-61ee-424d-81dc-e09b06a26db6} <Error> TCPHandler: Code: 43. DB::Exception: Second argument of function transform, must be array of source values to transform from.: While processing transform('hello', 'wrong', 1). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3aef44 in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:42:18.766138 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_123_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1110623 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:19.892554 [ 22358 ] {689b8f40-37d3-40d9-8b3b-b3c1b56181e7} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56384) (comment: 00156_max_execution_speed_sample_merge.sql) (in query: SELECT count() FROM merge(test, '^hits$') SAMPLE 1 / 2;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:19.892582 [ 22334 ] {1a4822fb-1ff3-4b3b-8e25-3a299d2c01a1} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:56336) (comment: 01292_create_user.sql) (in query: CREATE USER u4_01292@'::1';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./src/Access/DiskAccessStorage.cpp:0: DB::DiskAccessStorage::writeAccessEntityToDisk(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, DB::IAccessEntity const&) const @ 0x0000000035bf6035 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_map:1805: DB::DiskAccessStorage::insertNoLock(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool, bool) @ 0x0000000035bf09ed in /usr/bin/clickhouse
15. ./build_docker/./src/Access/DiskAccessStorage.cpp:0: DB::DiskAccessStorage::insertImpl(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool) @ 0x0000000035bf5726 in /usr/bin/clickhouse
16. ./build_docker/./src/Access/IAccessStorage.cpp:194: DB::IAccessStorage::insert(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool) @ 0x0000000035c8cda7 in /usr/bin/clickhouse
17. ./build_docker/./src/Access/MultipleAccessStorage.cpp:0: DB::MultipleAccessStorage::insertImpl(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool) @ 0x0000000035d49413 in /usr/bin/clickhouse
18. ./build_docker/./src/Access/AccessControl.cpp:550: DB::AccessControl::insertImpl(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool) @ 0x0000000035a6408f in /usr/bin/clickhouse
19. ./build_docker/./src/Access/IAccessStorage.cpp:218: DB::IAccessStorage::insert(std::vector<std::shared_ptr<DB::IAccessEntity const>, std::allocator<std::shared_ptr<DB::IAccessEntity const>>> const&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>> const&, bool, bool) @ 0x0000000035c8db6e in /usr/bin/clickhouse
20. ./build_docker/./src/Access/IAccessStorage.cpp:0: DB::IAccessStorage::insert(std::vector<std::shared_ptr<DB::IAccessEntity const>, std::allocator<std::shared_ptr<DB::IAccessEntity const>>> const&, bool, bool) @ 0x0000000035c8ce73 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::InterpreterCreateUserQuery::execute() @ 0x000000003ab4aceb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:42:21.038467 [ 22353 ] {76aa1711-c094-4491-8139-5d2a5ab6efd3} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 8650720 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 1048449): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43256) (comment: 00162_mmap_compression_none.sql) (in query: INSERT INTO hits_none SELECT Title FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:24.834296 [ 22335 ] {b2992b8d-44ef-43eb-badf-334e196f35b7} <Error> executeQuery: Code: 43. DB::Exception: Third argument of function transform, must be array of destination values to transform to.: While processing transform('hello', ['wrong'], 1). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43206) (comment: 00153_transform.sql) (in query: SELECT transform('hello', ['wrong'], 1);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3af147 in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:42:24.834473 [ 22363 ] {7fdbff99-64fc-4b3e-b773-d0319688d822} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43222) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:24.834642 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 4218943 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:24.834708 [ 22342 ] {4bc6583d-8ad2-4433-bab8-224b32ea4275} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47142) (comment: 00081_group_by_without_key_and_totals.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:24.834610 [ 22367 ] {9a03ac31-055e-4c63-9c11-c6245383c20e} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47128) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:42:24.834821 [ 2350 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:24.834783 [ 22334 ] {1a4822fb-1ff3-4b3b-8e25-3a299d2c01a1} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./src/Access/DiskAccessStorage.cpp:0: DB::DiskAccessStorage::writeAccessEntityToDisk(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, DB::IAccessEntity const&) const @ 0x0000000035bf6035 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_map:1805: DB::DiskAccessStorage::insertNoLock(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool, bool) @ 0x0000000035bf09ed in /usr/bin/clickhouse
15. ./build_docker/./src/Access/DiskAccessStorage.cpp:0: DB::DiskAccessStorage::insertImpl(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool) @ 0x0000000035bf5726 in /usr/bin/clickhouse
16. ./build_docker/./src/Access/IAccessStorage.cpp:194: DB::IAccessStorage::insert(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool) @ 0x0000000035c8cda7 in /usr/bin/clickhouse
17. ./build_docker/./src/Access/MultipleAccessStorage.cpp:0: DB::MultipleAccessStorage::insertImpl(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool) @ 0x0000000035d49413 in /usr/bin/clickhouse
18. ./build_docker/./src/Access/AccessControl.cpp:550: DB::AccessControl::insertImpl(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, std::shared_ptr<DB::IAccessEntity const> const&, bool, bool) @ 0x0000000035a6408f in /usr/bin/clickhouse
19. ./build_docker/./src/Access/IAccessStorage.cpp:218: DB::IAccessStorage::insert(std::vector<std::shared_ptr<DB::IAccessEntity const>, std::allocator<std::shared_ptr<DB::IAccessEntity const>>> const&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>> const&, bool, bool) @ 0x0000000035c8db6e in /usr/bin/clickhouse
20. ./build_docker/./src/Access/IAccessStorage.cpp:0: DB::IAccessStorage::insert(std::vector<std::shared_ptr<DB::IAccessEntity const>, std::allocator<std::shared_ptr<DB::IAccessEntity const>>> const&, bool, bool) @ 0x0000000035c8ce73 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::InterpreterCreateUserQuery::execute() @ 0x000000003ab4aceb in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:42:24.834476 [ 22360 ] {41c8f91e-00b6-473c-930d-e12a8583c01d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43220) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:24.834889 [ 22353 ] {76aa1711-c094-4491-8139-5d2a5ab6efd3} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 8650720 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 1048449): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:24.835139 [ 22366 ] {9e3c3328-79c1-4f48-a6a9-e2b4eb9f4096} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while pushing to view test_15.mv (552b0337-c9ca-41d0-8e2a-d36479e49aef). (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43232) (comment: 01069_materialized_view_alter_target_table.sql) (in query: INSERT INTO mv_source VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:42:24.834889 [ 22358 ] {689b8f40-37d3-40d9-8b3b-b3c1b56181e7} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:24.835539 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:24.835617 [ 2356 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:24.837035 [ 22335 ] {b2992b8d-44ef-43eb-badf-334e196f35b7} <Error> TCPHandler: Code: 43. DB::Exception: Third argument of function transform, must be array of destination values to transform to.: While processing transform('hello', ['wrong'], 1). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3af147 in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:42:24.837948 [ 22342 ] {4bc6583d-8ad2-4433-bab8-224b32ea4275} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:24.843587 [ 22366 ] {9e3c3328-79c1-4f48-a6a9-e2b4eb9f4096} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while pushing to view test_15.mv (552b0337-c9ca-41d0-8e2a-d36479e49aef). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:42:24.941775 [ 22360 ] {41c8f91e-00b6-473c-930d-e12a8583c01d} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:24.956967 [ 22367 ] {9a03ac31-055e-4c63-9c11-c6245383c20e} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:42:25.062521 [ 22335 ] {3f0835e3-3d8a-4078-98d6-de6a6b0b5007} <Error> executeQuery: Code: 43. DB::Exception: Function transform has signature: transform(T, Array(T), Array(U), U) -> U; or transform(T, Array(T), Array(T)) -> T; where T and U are types.: While processing transform('hello', ['wrong'], [1]). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43206) (comment: 00153_transform.sql) (in query: SELECT transform('hello', ['wrong'], [1]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3b0561 in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:42:25.064672 [ 22335 ] {3f0835e3-3d8a-4078-98d6-de6a6b0b5007} <Error> TCPHandler: Code: 43. DB::Exception: Function transform has signature: transform(T, Array(T), Array(U), U) -> U; or transform(T, Array(T), Array(T)) -> T; where T and U are types.: While processing transform('hello', ['wrong'], [1]). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3b0561 in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:42:26.696290 [ 2341 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:26.699607 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:26.699905 [ 22363 ] {7fdbff99-64fc-4b3e-b773-d0319688d822} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:26.699933 [ 22335 ] {2e7b4e7f-2d80-46cd-a802-b885ae653473} <Error> executeQuery: Code: 43. DB::Exception: First argument and elements of array of the second argument of function transform must have compatible types: While processing transform(tuple(1), ['sdf'], [1]). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43206) (comment: 00153_transform.sql) (in query: SELECT transform(tuple(1), ['sdf'], [1]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3afa0b in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:42:26.734320 [ 22335 ] {2e7b4e7f-2d80-46cd-a802-b885ae653473} <Error> TCPHandler: Code: 43. DB::Exception: First argument and elements of array of the second argument of function transform must have compatible types: While processing transform(tuple(1), ['sdf'], [1]). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionTransform::getReturnTypeImpl(std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&) const @ 0x000000001d3afa0b in /usr/bin/clickhouse
4. DB::IFunction::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c7bf6 in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:42:27.049900 [ 22363 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:27.064595 [ 22363 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:27.080060 [ 22363 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:27.085316 [ 22369 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:27.189489 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:27.239582 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4207098 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:27.245050 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 5235425 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:27.266751 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:27.300176 [ 22342 ] {ddc4ca2a-acde-4ec6-99ec-f88dd47eb30f} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 272 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39898) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:28.671384 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:28.671397 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4276919 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:28.671598 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4520381 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:28.672847 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:28.672858 [ 2432 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:28.698109 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_87_17}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1051207 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:28.925923 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:29.660952 [ 22342 ] {ddc4ca2a-acde-4ec6-99ec-f88dd47eb30f} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 272 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:29.679602 [ 2441 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:29.697418 [ 2322 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:39.617641 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:39.617828 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:39.617913 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:39.618213 [ 22335 ] {44be6478-cdad-4f3e-a90c-e093e6608f7c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39942) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:42.635393 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5198625 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:42.635627 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_1_1_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6682): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:42.637022 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4284567 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:42.637122 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 4208892 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:42.637176 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 5159456 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:42.637793 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_87_17}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1109834 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/600/600ff0c8-1b35-4b24-8e1e-af77c572915c/202409_1_82_16/ in table system.asynchronous_metric_log (600ff0c8-1b35-4b24-8e1e-af77c572915c) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressionCodecMultiple::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x00000000368e3947 in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/ICompressionCodec.cpp:112: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x00000000369cfaaa in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:287: DB::CompressedReadBufferBase::decompressTo(char*, unsigned long, unsigned long) @ 0x00000000368aa372 in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:138: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae79d in /usr/bin/clickhouse
13. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:43.420626 [ 22337 ] {53645ef0-762f-4d63-a25f-7860f0672695} <Error> executeQuery: Code: 57. DB::Exception: Cannot attach table with UUID 690edb25-4a4f-4b71-a080-4a38a2679629, because it was detached but still used by some query. Retry later. (TABLE_ALREADY_EXISTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43880) (comment: 01107_atomic_db_detach_attach.sh) (in query: ATTACH TABLE test_01107.mt), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&>(int, FormatStringHelperImpl<std::type_identity<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&>::type>, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&) @ 0x00000000370dd26d in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:368: DB::DatabaseAtomic::assertDetachedTableNotInUse(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&) @ 0x00000000370c5194 in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::checkDetachedTableNotInUse(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&) @ 0x00000000370dc7df in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f35c3 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:43.420717 [ 22335 ] {44be6478-cdad-4f3e-a90c-e093e6608f7c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:43.420875 [ 2351 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:43.421087 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:43.421150 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:43.424793 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {34de62b1-a73e-4f5d-b181-1a6961edb6b8::202409_1_96_19}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1092543 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:43.425014 [ 2403 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:43.420849 [ 22367 ] {2b8fd5a1-64f6-4017-936e-3e1edf41ffda} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 146.87 MiB (attempt to allocate chunk of 1052047 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39980) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:43.425036 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1326504 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<unsigned long>::insert(DB::Field const&) @ 0x000000003b2cac89 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x000000003b24c1a0 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnArray.cpp:0: DB::ColumnArray::insert(DB::Field const&) @ 0x000000003ac9cd2d in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnMap.cpp:0: DB::ColumnMap::insert(DB::Field const&) @ 0x000000003b13b49a in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b8d0a23 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:43.543673 [ 22337 ] {53645ef0-762f-4d63-a25f-7860f0672695} <Error> TCPHandler: Code: 57. DB::Exception: Cannot attach table with UUID 690edb25-4a4f-4b71-a080-4a38a2679629, because it was detached but still used by some query. Retry later. (TABLE_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&>(int, FormatStringHelperImpl<std::type_identity<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&>::type>, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&) @ 0x00000000370dd26d in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:368: DB::DatabaseAtomic::assertDetachedTableNotInUse(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&) @ 0x00000000370c5194 in /usr/bin/clickhouse
4. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::checkDetachedTableNotInUse(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&) @ 0x00000000370dc7df in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f35c3 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:44.908948 [ 22363 ] {beb45a3e-e52b-4937-b512-e09ef6f77e71} <Error> executeQuery: Code: 219. DB::Exception: Database test_01107 cannot be detached, because some tables are still in use. Retry later. (DATABASE_NOT_EMPTY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43952) (comment: 01107_atomic_db_detach_attach.sh) (in query: DETACH DATABASE test_01107), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:408: DB::DatabaseAtomic::assertCanBeDetached(bool) @ 0x00000000370d2e68 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:395: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x000000003965192c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000039645d0d in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643f56 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:44.909094 [ 2434 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:44.909090 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:44.971906 [ 22363 ] {beb45a3e-e52b-4937-b512-e09ef6f77e71} <Error> TCPHandler: Code: 219. DB::Exception: Database test_01107 cannot be detached, because some tables are still in use. Retry later. (DATABASE_NOT_EMPTY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:408: DB::DatabaseAtomic::assertCanBeDetached(bool) @ 0x00000000370d2e68 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:395: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x000000003965192c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000039645d0d in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000039643f56 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:45.000144 [ 22334 ] {a291084c-936b-4601-a6eb-4da3a0671fb7} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1957120 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 123.56462097167969, avg_chars_size = 138.67754516601562, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 144 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39892) (comment: 00093_prewhere_array_join.sql) (in query: SELECT arrayJoin([0]) AS browser, arrayJoin([SearchEngineID]) AS search_engine, URL FROM test.hits WHERE 1 AND (SearchEngineID != 0) AND (browser != 0) AND (search_engine != 0) FORMAT Null;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:45.117872 [ 22367 ] {2b8fd5a1-64f6-4017-936e-3e1edf41ffda} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 146.87 MiB (attempt to allocate chunk of 1052047 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:45.410837 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:45.427447 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1123860 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_4_4_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6214): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368aedff in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e673 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:45.663071 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:45.741684 [ 22334 ] {a291084c-936b-4601-a6eb-4da3a0671fb7} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1957120 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 123.56462097167969, avg_chars_size = 138.67754516601562, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 144 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:45.939062 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:45.939816 [ 22337 ] {c2368226-e785-46bb-bb4f-69a8becf7439} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43942) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:45.964314 [ 2395 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:45.964882 [ 2395 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:46.967718 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4453157 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:46.968771 [ 2398 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:46.968792 [ 2394 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.128738 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.204920 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1822276 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_2_2_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6553): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.217218 [ 22322 ] {e9179c54-0a6b-46c2-bf48-e895f740525e} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 9.03 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40158) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.365654 [ 22322 ] {e9179c54-0a6b-46c2-bf48-e895f740525e} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 9.03 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.516930 [ 22367 ] {2f2e9556-e783-41ba-9c90-51655607ed91} <Error> executeQuery: Code: 241. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Memory tracker (for query): fault injected. Would use 9.03 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43744) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT sum(cityHash64(*)) FROM (SELECT CounterID, quantileTiming(0.5)(SendTiming), count() FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) WHERE SendTiming != -1 GROUP BY CounterID) SETTINGS max_block_size = 63169;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:42:47.664024 [ 22334 ] {ca8f9430-ead7-46f7-af76-6851936c7996} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:58144). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:58144) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.674875 [ 22341 ] {e71c0fe8-5b2a-4589-b1a0-9212d5bbd202} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:60872). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60872) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.685205 [ 22326 ] {38221928-8aa1-42c8-aa50-e5bf18ba7314} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:37542). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37542) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.691287 [ 22341 ] {e71c0fe8-5b2a-4589-b1a0-9212d5bbd202} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:60872). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.691776 [ 22341 ] {e71c0fe8-5b2a-4589-b1a0-9212d5bbd202} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:60872). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.694204 [ 22363 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:35558). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.700550 [ 22334 ] {ca8f9430-ead7-46f7-af76-6851936c7996} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:58144). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.700987 [ 22334 ] {ca8f9430-ead7-46f7-af76-6851936c7996} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:58144). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.711726 [ 22341 ] {e71c0fe8-5b2a-4589-b1a0-9212d5bbd202} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:42:47.719070 [ 22367 ] {2f2e9556-e783-41ba-9c90-51655607ed91} <Error> TCPHandler: Code: 241. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Memory tracker (for query): fault injected. Would use 9.03 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:42:47.723020 [ 22334 ] {ca8f9430-ead7-46f7-af76-6851936c7996} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:42:47.730695 [ 22323 ] {a4487293-4e31-427a-aecc-82c6526a83ee} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:39060). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39060) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.747010 [ 22347 ] {1bb4d520-408e-428b-8b48-b1a40be0b616} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:48136). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48136) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.762371 [ 22332 ] {036be492-9f91-4adb-ae0f-dea15172e5cd} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:42768). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42768) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.763053 [ 22347 ] {1bb4d520-408e-428b-8b48-b1a40be0b616} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:48136). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.763539 [ 22347 ] {1bb4d520-408e-428b-8b48-b1a40be0b616} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:48136). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.766759 [ 22327 ] {3701b862-aac6-435a-a9cf-6347c23d3a7f} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:44156). (NETWORK_ERROR) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44156) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.776562 [ 22347 ] {1bb4d520-408e-428b-8b48-b1a40be0b616} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:42:47.778147 [ 22332 ] {036be492-9f91-4adb-ae0f-dea15172e5cd} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:42768). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.778865 [ 22332 ] {036be492-9f91-4adb-ae0f-dea15172e5cd} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:42768). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x000000003e0c768b in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a8a69 in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
12. ? @ 0x00007fea4cb39ac3 in ?
13. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.791863 [ 22326 ] {38221928-8aa1-42c8-aa50-e5bf18ba7314} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:37542). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.792400 [ 22326 ] {38221928-8aa1-42c8-aa50-e5bf18ba7314} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:37542). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.798994 [ 22332 ] {036be492-9f91-4adb-ae0f-dea15172e5cd} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:42:47.803479 [ 22324 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:38866). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.804254 [ 22326 ] {38221928-8aa1-42c8-aa50-e5bf18ba7314} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:42:47.820795 [ 22323 ] {a4487293-4e31-427a-aecc-82c6526a83ee} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:39060). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.821252 [ 22323 ] {a4487293-4e31-427a-aecc-82c6526a83ee} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:39060). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.839840 [ 22323 ] {a4487293-4e31-427a-aecc-82c6526a83ee} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:42:47.862974 [ 22327 ] {3701b862-aac6-435a-a9cf-6347c23d3a7f} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:44156). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.863401 [ 22327 ] {3701b862-aac6-435a-a9cf-6347c23d3a7f} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:44156). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x000000003e0c52c7 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c466f in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:47.888750 [ 22327 ] {3701b862-aac6-435a-a9cf-6347c23d3a7f} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:42:47.969475 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:47.969572 [ 2335 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:48.034053 [ 22337 ] {c2368226-e785-46bb-bb4f-69a8becf7439} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:49.638306 [ 2423 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:49.638405 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:49.638408 [ 22348 ] {ca14c08f-0727-40b3-9639-1c6a1f82a6a6} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 237.78 MiB (attempt to allocate chunk of 1052672 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43762) (comment: 00033_aggregate_key_string.sql) (in query: SELECT SearchPhrase AS k1, count() AS c FROM test.hits GROUP BY k1 ORDER BY c DESC, k1 LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable<StringKey24, StringHashMapCell<StringKey24, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::alloc(StringHashTableGrower<8ul> const&) @ 0x00000000381cc7cb in /usr/bin/clickhouse
8. ./build_docker/./src/Common/HashTable/StringHashTable.h:228: StringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>>::StringHashTable() @ 0x00000000381cbf05 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/TwoLevelStringHashTable.h:43: TwoLevelStringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>, StringHashMap<char*, Allocator<true, true>>, 8ul>::TwoLevelStringHashTable<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x00000000381ca429 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/TwoLevelStringHashMap.h:0: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x0000000037db7fc4 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabd1 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
18. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:51.645192 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.827794 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 5115400 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.827819 [ 22342 ] {9ac3b90c-7ffd-4896-9c91-9087daff2eab} <Error> executeQuery: Code: 44. DB::Exception: The argument of function defaultValueOfTypeName must be a constant string describing type.: While processing defaultValueOfTypeName(FQDN()). (ILLEGAL_COLUMN) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43834) (comment: 01459_default_value_of_argument_type_nullptr_dereference.sql) (in query: SELECT defaultValueOfTypeName(FQDN());), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionDefaultValueOfTypeName::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000f044908 in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:445: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca757 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:42:53.827844 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 4233980 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.827946 [ 22348 ] {ca14c08f-0727-40b3-9639-1c6a1f82a6a6} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 237.78 MiB (attempt to allocate chunk of 1052672 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable<StringKey24, StringHashMapCell<StringKey24, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::alloc(StringHashTableGrower<8ul> const&) @ 0x00000000381cc7cb in /usr/bin/clickhouse
8. ./build_docker/./src/Common/HashTable/StringHashTable.h:228: StringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>>::StringHashTable() @ 0x00000000381cbf05 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/TwoLevelStringHashTable.h:43: TwoLevelStringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>, StringHashMap<char*, Allocator<true, true>>, 8ul>::TwoLevelStringHashTable<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x00000000381ca429 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/TwoLevelStringHashMap.h:0: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x0000000037db7fc4 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabd1 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
18. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:53.827925 [ 22335 ] {54819734-da89-44da-8b9c-181c925580a9} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43804) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnFixedString.cpp:339: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnFixedString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b0c887a in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnFixedString.cpp:314: DB::ColumnFixedString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08c97c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3f104 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:53.828149 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4216767 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.828129 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5219361 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.828141 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4313980 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.828139 [ 2386 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.828055 [ 2324 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.828560 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1123860 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_4_4_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6214): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.828591 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:167: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000003700474d in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.828561 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e17112c4-2272-4759-a0b5-9cbed7d197e8::202409_1_18_4}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1123135 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.847184 [ 22342 ] {9ac3b90c-7ffd-4896-9c91-9087daff2eab} <Error> TCPHandler: Code: 44. DB::Exception: The argument of function defaultValueOfTypeName must be a constant string describing type.: While processing defaultValueOfTypeName(FQDN()). (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionDefaultValueOfTypeName::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000f044908 in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:445: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca757 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:42:53.871465 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1189512 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:53.879702 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1411454 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:54.411718 [ 22335 ] {54819734-da89-44da-8b9c-181c925580a9} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnFixedString.cpp:339: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnFixedString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b0c887a in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnFixedString.cpp:314: DB::ColumnFixedString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08c97c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3f104 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:54.841829 [ 2436 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:54.843461 [ 2440 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:55.842543 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:55.847333 [ 2355 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:56.230456 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 2014698 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_8_8_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6867): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:56.255465 [ 22323 ] {08c122e1-81dc-4f45-bdd2-c56287045a98} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1050448 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60724) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:56.614442 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:56.853528 [ 2392 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:56.878483 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:56.878717 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp2a2c7410-b108-438e-be09-7eddf6047ea7' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:42:56.930425 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.69 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:57.196025 [ 2537 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp8514e635-c756-429e-9b49-c6018e19bbda' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:42:57.219035 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:57.219307 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1049812 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_71_71_0/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 130): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:57.294220 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1066748 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column event_time): (while reading from part /var/lib/clickhouse/disks/s3/store/d88/d88f6a6d-9cdb-42d7-874b-d9e099182172/202409_1_74_14/ in table system.zookeeper_log (d88f6a6d-9cdb-42d7-874b-d9e099182172) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:57.672151 [ 2533 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp0f21c2b9-fe87-4414-9722-5b6a6dcb3951' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:42:59.987711 [ 2341 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:59.987830 [ 22323 ] {08c122e1-81dc-4f45-bdd2-c56287045a98} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1050448 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:42:59.988060 [ 2326 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:42:59.999647 [ 22342 ] {5b80aabb-4d4f-4a40-b9fa-508786fabaae} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 102.12 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60764) (comment: 00083_array_filter.sql) (in query: SELECT sum(length(ParsedParams.ValueDouble)) FROM test.hits WHERE notEmpty(ParsedParams.ValueDouble);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:00.035098 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:00.291654 [ 2531 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp82fd6c3c-0ab8-4874-ac22-20ded8db8f1c' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:43:04.772102 [ 22353 ] {8c32e1f8-9b0d-4fda-bb5c-2edf558f4328} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1067071 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43862) (comment: 02251_alter_enum_nested_struct.sql) (in query: OPTIMIZE TABLE alter_enum_array FINAL;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.h:104: DB::StorageMergeTree::merge(bool, String const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::MergeTreeTransaction> const&, String&, bool) @ 0x000000003da40f6f in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/StorageMergeTree.cpp:1520: DB::StorageMergeTree::optimize(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::IAST> const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da55447 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:436: DB::InterpreterOptimizeQuery::execute() @ 0x0000000039aedf74 in /usr/bin/clickhouse

2024.09.24 02:43:04.794646 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4195259 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned short, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208b42fb in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.h:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnVector<unsigned short>::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b49733f in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/ColumnVector.cpp:729: DB::ColumnVector<unsigned short>::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b299205 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPartWriter.cpp:0: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d135ce2 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:166: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11e92d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4063f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174091 [ 22334 ] {335b93de-905e-4458-9352-2cc5d2e15ae5} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1056768 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60740) (comment: 00044_any_left_join_string.sql) (in query: SELECT domain, hits, visits FROM ( SELECT domain(URL) AS domain, count() AS hits FROM test.hits GROUP BY domain ) ANY LEFT JOIN ( SELECT domain(StartURL) AS domain, sum(Sign) AS visits FROM test.visits GROUP BY domain ) USING domain ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable<StringKey24, StringHashMapCell<StringKey24, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::alloc(StringHashTableGrower<8ul> const&) @ 0x00000000381cc7cb in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/StringHashTable.h:228: StringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>>::StringHashTable() @ 0x00000000381cbf05 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/HashTable/TwoLevelStringHashTable.h:43: TwoLevelStringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>, StringHashMap<char*, Allocator<true, true>>, 8ul>::TwoLevelStringHashTable<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x00000000381ca429 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/HashTable/TwoLevelStringHashMap.h:0: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x0000000037db7fc4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:06.174141 [ 22342 ] {5b80aabb-4d4f-4a40-b9fa-508786fabaae} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 102.12 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:06.174118 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174304 [ 2382 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174249 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 5168961 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174405 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4216767 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174455 [ 2391 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174483 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174717 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 4272380 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174808 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4968989 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174892 [ 22353 ] {8c32e1f8-9b0d-4fda-bb5c-2edf558f4328} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1067071 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.h:104: DB::StorageMergeTree::merge(bool, String const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::MergeTreeTransaction> const&, String&, bool) @ 0x000000003da40f6f in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/StorageMergeTree.cpp:1520: DB::StorageMergeTree::optimize(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::IAST> const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000003da55447 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:436: DB::InterpreterOptimizeQuery::execute() @ 0x0000000039aedf74 in /usr/bin/clickhouse

2024.09.24 02:43:06.174947 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4281415 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.174982 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1338038 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column path): (while reading from part /var/lib/clickhouse/disks/s3/store/d88/d88f6a6d-9cdb-42d7-874b-d9e099182172/202409_1_74_14/ in table system.zookeeper_log (d88f6a6d-9cdb-42d7-874b-d9e099182172) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.182477 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.240191 [ 22323 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:06.258062 [ 22334 ] {335b93de-905e-4458-9352-2cc5d2e15ae5} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1056768 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable<StringKey24, StringHashMapCell<StringKey24, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::alloc(StringHashTableGrower<8ul> const&) @ 0x00000000381cc7cb in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/StringHashTable.h:228: StringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>>::StringHashTable() @ 0x00000000381cbf05 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/HashTable/TwoLevelStringHashTable.h:43: TwoLevelStringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>, StringHashMap<char*, Allocator<true, true>>, 8ul>::TwoLevelStringHashTable<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x00000000381ca429 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/HashTable/TwoLevelStringHashMap.h:0: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x0000000037db7fc4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:07.452611 [ 22358 ] {b58bac58-0abd-407f-a3aa-96b92c282d43} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39912) (comment: 00077_log_tinylog_stripelog.sql) (in query: INSERT INTO test.hits_tinylog SELECT CounterID, AdvEngineID, RegionID, SearchPhrase, UserID FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/StorageLog.cpp:326: DB::LogSink::Stream::Stream(std::shared_ptr<DB::IDisk> const&, String const&, unsigned long, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x000000003c5d762f in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:259: std::pair<String const, DB::LogSink::Stream>::pair[abi:v15000]<String const&, std::shared_ptr<DB::IDisk> const&, String const&, unsigned long&&, std::shared_ptr<DB::ICompressionCodec>&&, unsigned long const&>(std::piecewise_construct_t, std::tuple<String const&>, std::tuple<std::shared_ptr<DB::IDisk> const&, String const&, unsigned long&&, std::shared_ptr<DB::ICompressionCodec>&&, unsigned long const&>) @ 0x000000003c5d7090 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__tree:2134: std::pair<std::__tree_iterator<std::__value_type<String, DB::LogSink::Stream>, std::__tree_node<std::__value_type<String, DB::LogSink::Stream>, void*>*, long>, bool> std::__tree<std::__value_type<String, DB::LogSink::Stream>, std::__map_value_compare<String, std::__value_type<String, DB::LogSink::Stream>, std::less<String>, true>, std::allocator<std::__value_type<String, DB::LogSink::Stream>>>::__emplace_unique_key_args<String, std::piecewise_construct_t const&, std::tuple<String const&>, std::tuple<std::shared_ptr<DB::IDisk> const&, String const&, unsigned long&&, std::shared_ptr<DB::ICompressionCodec>&&, unsigned long const&>>(String const&, std::piecewise_construct_t const&, std::tuple<String const&>&&, std::tuple<std::shared_ptr<DB::IDisk> const&, String const&, unsigned long&&, std::shared_ptr<DB::ICompressionCodec>&&, unsigned long const&>&&) @ 0x000000003c5d6624 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::LogSink::writeData(DB::NameAndTypePair const&, DB::IColumn const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003c5c559d in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::LogSink::writeData(DB::NameAndTypePair const&, DB::IColumn const&) @ 0x000000003c5a6786 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageLog.cpp:375: DB::LogSink::consume(DB::Chunk) @ 0x000000003c5a5e61 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse

2024.09.24 02:43:07.452733 [ 22367 ] {7ad29da2-ebdf-4aac-8758-ce8ef0295cf7} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35280) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:43:07.463615 [ 22358 ] {b58bac58-0abd-407f-a3aa-96b92c282d43} <Warning> FileChecker: Will truncate file store/e40/e40eafa8-8ab6-4dbb-9de9-0a6bb381fb25/AdvEngineID.bin that has size 15583 to size 0
2024.09.24 02:43:07.464152 [ 22358 ] {b58bac58-0abd-407f-a3aa-96b92c282d43} <Warning> FileChecker: Will truncate file store/e40/e40eafa8-8ab6-4dbb-9de9-0a6bb381fb25/CounterID.bin that has size 51922 to size 0
2024.09.24 02:43:07.464295 [ 22358 ] {b58bac58-0abd-407f-a3aa-96b92c282d43} <Warning> FileChecker: Will truncate file store/e40/e40eafa8-8ab6-4dbb-9de9-0a6bb381fb25/RegionID.bin that has size 649627 to size 0
2024.09.24 02:43:07.464516 [ 22358 ] {b58bac58-0abd-407f-a3aa-96b92c282d43} <Warning> FileChecker: Will truncate file store/e40/e40eafa8-8ab6-4dbb-9de9-0a6bb381fb25/SearchPhrase.bin that has size 1695478 to size 0
2024.09.24 02:43:08.718213 [ 22366 ] {e612a6bb-84c9-4204-aa75-8a092a528083} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1049151 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35284) (comment: 01493_alter_remove_properties_zookeeper.sql) (in query: CREATE TABLE r_prop_table1 ( column_default UInt64 DEFAULT 42, column_codec String CODEC(ZSTD(10)), column_comment Date COMMENT 'Some comment', column_ttl UInt64 TTL column_comment + INTERVAL 1 MONTH ) ENGINE ReplicatedMergeTree('/clickhouse/{database}/test_01493/r_prop_table', '1') ORDER BY tuple() TTL column_comment + INTERVAL 2 MONTH;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool) @ 0x000000003bf461f7 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageReplicatedMergeTree> std::allocate_shared[abi:v15000]<DB::StorageReplicatedMergeTree, std::allocator<DB::StorageReplicatedMergeTree>, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator<DB::StorageReplicatedMergeTree> const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x000000003da14334 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da076e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:43:09.948268 [ 22335 ] {bf547d47-63c9-431f-9b5b-b8f68181f60c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1058303 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 71358): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60812) (comment: 00074_full_join.sql) (in query: SELECT CounterID, hits, visits FROM ( SELECT (CounterID % 100000) AS CounterID, count() AS hits FROM test.hits GROUP BY CounterID ) ANY LEFT JOIN ( SELECT (CounterID % 100000) AS CounterID, sum(Sign) AS visits FROM test.visits GROUP BY CounterID HAVING visits > 0 ) USING CounterID WHERE hits = 0 OR visits = 0 ORDER BY hits + visits * 10 DESC, CounterID ASC LIMIT 20;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368aedff in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse

2024.09.24 02:43:09.948320 [ 22363 ] {a2bd6b70-624d-49f9-9a41-38599ee51260} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:60826) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:11.104040 [ 2375 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.104024 [ 22369 ] {3fbf10be-b642-4c61-9f59-09e1fffbd27b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40254) (comment: 02124_insert_deduplication_token_multiple_blocks.sh) (in query: INSERT INTO block_dedup_token VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:281: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66bd97 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse

2024.09.24 02:43:11.104077 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1052038 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435e51 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:322: DB::ColumnVector<long>::insertDefault() @ 0x000000003b354a15 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::ColumnSparse(COW<DB::IColumn>::mutable_ptr<DB::IColumn>&&) @ 0x000000003b1a1813 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::IDataType::createColumn(DB::ISerialization const&) const @ 0x0000000036dd5efa in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:140: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d473eda in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.104142 [ 2425 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.104206 [ 22358 ] {b58bac58-0abd-407f-a3aa-96b92c282d43} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, std::__fs::filesystem::path, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr<DB::Throttler> const&) @ 0x0000000037262e43 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003724bf5b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/StorageLog.cpp:326: DB::LogSink::Stream::Stream(std::shared_ptr<DB::IDisk> const&, String const&, unsigned long, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x000000003c5d762f in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:259: std::pair<String const, DB::LogSink::Stream>::pair[abi:v15000]<String const&, std::shared_ptr<DB::IDisk> const&, String const&, unsigned long&&, std::shared_ptr<DB::ICompressionCodec>&&, unsigned long const&>(std::piecewise_construct_t, std::tuple<String const&>, std::tuple<std::shared_ptr<DB::IDisk> const&, String const&, unsigned long&&, std::shared_ptr<DB::ICompressionCodec>&&, unsigned long const&>) @ 0x000000003c5d7090 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__tree:2134: std::pair<std::__tree_iterator<std::__value_type<String, DB::LogSink::Stream>, std::__tree_node<std::__value_type<String, DB::LogSink::Stream>, void*>*, long>, bool> std::__tree<std::__value_type<String, DB::LogSink::Stream>, std::__map_value_compare<String, std::__value_type<String, DB::LogSink::Stream>, std::less<String>, true>, std::allocator<std::__value_type<String, DB::LogSink::Stream>>>::__emplace_unique_key_args<String, std::piecewise_construct_t const&, std::tuple<String const&>, std::tuple<std::shared_ptr<DB::IDisk> const&, String const&, unsigned long&&, std::shared_ptr<DB::ICompressionCodec>&&, unsigned long const&>>(String const&, std::piecewise_construct_t const&, std::tuple<String const&>&&, std::tuple<std::shared_ptr<DB::IDisk> const&, String const&, unsigned long&&, std::shared_ptr<DB::ICompressionCodec>&&, unsigned long const&>&&) @ 0x000000003c5d6624 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::LogSink::writeData(DB::NameAndTypePair const&, DB::IColumn const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003c5c559d in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::LogSink::writeData(DB::NameAndTypePair const&, DB::IColumn const&) @ 0x000000003c5a6786 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageLog.cpp:375: DB::LogSink::consume(DB::Chunk) @ 0x000000003c5a5e61 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse

2024.09.24 02:43:11.104146 [ 22367 ] {7ad29da2-ebdf-4aac-8758-ce8ef0295cf7} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:43:11.104332 [ 22323 ] {4e42288f-9abb-4a13-9b50-e01b8b90d47e} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35320) (comment: 00848_join_use_nulls_segfault.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:11.104474 [ 2585 ] {} <Error> void DB::SystemLog<DB::SessionLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4282342 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::SessionLogElement>::flushImpl(std::vector<DB::SessionLogElement, std::allocator<DB::SessionLogElement>> const&, unsigned long) @ 0x000000003a466b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::SessionLogElement>::savingThreadFunction() @ 0x000000003a463e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::SessionLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::SessionLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c49627 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.104525 [ 22366 ] {e612a6bb-84c9-4204-aa75-8a092a528083} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1049151 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool) @ 0x000000003bf461f7 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageReplicatedMergeTree> std::allocate_shared[abi:v15000]<DB::StorageReplicatedMergeTree, std::allocator<DB::StorageReplicatedMergeTree>, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator<DB::StorageReplicatedMergeTree> const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x000000003da14334 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da076e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:43:11.104715 [ 22363 ] {a2bd6b70-624d-49f9-9a41-38599ee51260} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048704 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:11.104747 [ 22335 ] {bf547d47-63c9-431f-9b5b-b8f68181f60c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1058303 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 71358): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368aedff in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse

2024.09.24 02:43:11.104793 [ 22325 ] {adb6c07c-9058-425d-b70e-2d4166746d14} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35306) (comment: 00072_compare_date_and_string_index.sql) (in query: SELECT count() FROM test.hits WHERE EventDate < '2014-03-18';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:11.111894 [ 22323 ] {4e42288f-9abb-4a13-9b50-e01b8b90d47e} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:11.226303 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {f9daad03-8197-4a22-97ea-3583d7fdce05::202409_1_25_5}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1166551 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.242379 [ 22325 ] {adb6c07c-9058-425d-b70e-2d4166746d14} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:11.340117 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1326504 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<unsigned long>::insert(DB::Field const&) @ 0x000000003b2cac89 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x000000003b24c1a0 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnArray.cpp:0: DB::ColumnArray::insert(DB::Field const&) @ 0x000000003ac9cd2d in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnMap.cpp:0: DB::ColumnMap::insert(DB::Field const&) @ 0x000000003b13b49a in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b8d0a23 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.343780 [ 22369 ] {3fbf10be-b642-4c61-9f59-09e1fffbd27b} <Error> DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:281: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66bd97 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.347262 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1765555 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_2_2_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6553): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.516853 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1066748 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column event_time): (while reading from part /var/lib/clickhouse/disks/s3/store/d88/d88f6a6d-9cdb-42d7-874b-d9e099182172/202409_1_74_14/ in table system.zookeeper_log (d88f6a6d-9cdb-42d7-874b-d9e099182172) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:11.986915 [ 22337 ] {c6f16a2f-4079-47e4-b3f8-55c120101dbd} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2032004 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 236.2105712890625, avg_chars_size = 273.85268554687497, limit = 4096): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 158 with max_rows_to_read = 4096): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35336) (comment: 00071_merge_tree_optimize_aio.sql) (in query: INSERT INTO test.hits_snippet(EventTime, EventDate, CounterID, UserID, URL, Referer) SELECT EventTime, EventDate, CounterID, UserID, URL, Referer FROM test.hits WHERE EventDate = toDate('2014-03-18') ORDER BY EventTime, EventDate, CounterID, UserID, URL, Referer ASC LIMIT 50;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:12.105816 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:12.106478 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:13.109968 [ 2459 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:13.110174 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:13.677832 [ 22337 ] {c6f16a2f-4079-47e4-b3f8-55c120101dbd} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2032004 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 236.2105712890625, avg_chars_size = 273.85268554687497, limit = 4096): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 158 with max_rows_to_read = 4096): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:13.986231 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5167425 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:13.990946 [ 22348 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:14.035192 [ 22348 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:14.081337 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1498358 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_1_1_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6682): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:14.116290 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:14.116289 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:14.550836 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp22105fd1-7614-4917-901e-7858e99fa975' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:43:17.518163 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4216767 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.518219 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4276919 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.518165 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 5150143 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.518503 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 4362936 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.518599 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.518586 [ 22366 ] {1b75fc04-7fd6-46da-98a0-53e9ce7f8a6d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1114112 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35344) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:43:17.518771 [ 22369 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.519589 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.519645 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 4217021 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.519703 [ 2396 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.519786 [ 2373 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.520243 [ 22323 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.520688 [ 22334 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.525647 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.539357 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:167: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000003700474d in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.687026 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1146752 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::createWithOffsets(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::Field const&, unsigned long, unsigned long) const @ 0x000000003b8d0d91 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::convertToFullColumnIfSparse() const @ 0x000000003b1a7079 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::recursiveRemoveSparse(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x000000003b1b50f7 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.cpp:0: DB::convertToFullIfSparse(DB::Chunk&) @ 0x000000003e1ab758 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Merges/Algorithms/IMergingAlgorithm.h:43: DB::IMergingTransformBase::prepareInitializeInputs() @ 0x000000003ee6ac32 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Merges/IMergingTransform.cpp:164: DB::IMergingTransformBase::prepare() @ 0x000000003ee6e436 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/IProcessor.h:193: DB::IProcessor::prepare(std::vector<unsigned long, std::allocator<unsigned long>> const&, std::vector<unsigned long, std::allocator<unsigned long>> const&) @ 0x0000000020f081fd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/ExecutingGraph.cpp:0: DB::ExecutingGraph::updateNode(unsigned long, std::queue<DB::ExecutingGraph::Node*, std::deque<DB::ExecutingGraph::Node*, std::allocator<DB::ExecutingGraph::Node*>>>&, std::queue<DB::ExecutingGraph::Node*, std::deque<DB::ExecutingGraph::Node*, std::allocator<DB::ExecutingGraph::Node*>>>&) @ 0x000000003e20d64d in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:270: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fd195 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:17.926704 [ 22333 ] {ea4c99e2-2e2c-4f50-bc7e-562b109583e7} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.417612467 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33744) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:17.953233 [ 22333 ] {ea4c99e2-2e2c-4f50-bc7e-562b109583e7} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.417612467 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:18.293929 [ 22322 ] {3fa46c2f-4f5f-4944-9ea1-0dcf81164c60} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.343984132 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35402) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:20.965552 [ 22333 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:33744). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:20.965558 [ 22366 ] {1b75fc04-7fd6-46da-98a0-53e9ce7f8a6d} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1114112 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:43:20.971082 [ 2366 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:20.971071 [ 2331 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:20.965845 [ 22324 ] {4164b549-fbc3-46c3-b24b-0a3463c740ce} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 146.31 MiB (attempt to allocate chunk of 1048704 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35418) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:20.971178 [ 22322 ] {3fa46c2f-4f5f-4944-9ea1-0dcf81164c60} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.343984132 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:21.519465 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:21.634504 [ 22324 ] {4164b549-fbc3-46c3-b24b-0a3463c740ce} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 146.31 MiB (attempt to allocate chunk of 1048704 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<DB::(anonymous namespace)::ValueWithIndex<unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000003b26013f in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.cpp:0: auto DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto)::operator()<unsigned long*, unsigned long*, DB::ColumnVector<unsigned int>::less>(auto, auto, auto) const @ 0x000000003b4cd969 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/IColumnImpl.h:0: void DB::IColumn::updatePermutationImpl<DB::ColumnVector<unsigned int>::less, DB::ColumnVector<unsigned int>::equals, DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto), DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const::'lambda'(auto, auto, auto, auto)>(unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&, auto, auto, auto, auto) const @ 0x000000003b2a78f7 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnVector.cpp:401: DB::ColumnVector<unsigned int>::updatePermutation(DB::IColumn::PermutationSortDirection, DB::IColumn::PermutationSortStability, unsigned long, int, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, std::vector<std::pair<unsigned long, unsigned long>, std::allocator<std::pair<unsigned long, unsigned long>>>&) const @ 0x000000003b2a721e in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:190: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa4047b in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:21.971899 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:22.003637 [ 2399 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:22.975490 [ 2324 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:23.008389 [ 2461 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:23.137488 [ 22342 ] {d0e5d836-3700-4c31-8d4c-bec6ae95643a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1052672 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52218) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable<StringKey24, StringHashMapCell<StringKey24, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::alloc(StringHashTableGrower<8ul> const&) @ 0x00000000381cc7cb in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/StringHashTable.h:228: StringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>>::StringHashTable() @ 0x00000000381cbf05 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/HashTable/TwoLevelStringHashTable.h:43: TwoLevelStringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>, StringHashMap<char*, Allocator<true, true>>, 8ul>::TwoLevelStringHashTable<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x00000000381ca429 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/HashTable/TwoLevelStringHashMap.h:0: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x0000000037db7fc4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:23.169188 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1118460 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:23.756208 [ 22363 ] {cfdf0b69-a17b-4bd1-b02d-f5796f284419} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.056698511 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40930) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:23.756284 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1049571 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435e51 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:322: DB::ColumnVector<long>::insertDefault() @ 0x000000003b354a15 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::ColumnSparse(COW<DB::IColumn>::mutable_ptr<DB::IColumn>&&) @ 0x000000003b1a1813 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: DB::IDataType::createColumn(DB::ISerialization const&) const @ 0x0000000036dd5efa in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:140: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d473eda in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:23.756227 [ 22342 ] {d0e5d836-3700-4c31-8d4c-bec6ae95643a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1052672 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable<StringKey24, StringHashMapCell<StringKey24, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::alloc(StringHashTableGrower<8ul> const&) @ 0x00000000381cc7cb in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/StringHashTable.h:228: StringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>>::StringHashTable() @ 0x00000000381cbf05 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/HashTable/TwoLevelStringHashTable.h:43: TwoLevelStringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>, StringHashMap<char*, Allocator<true, true>>, 8ul>::TwoLevelStringHashTable<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x00000000381ca429 in /usr/bin/clickhouse
12. ./build_docker/./src/Common/HashTable/TwoLevelStringHashMap.h:0: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x0000000037db7fc4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:24.812341 [ 22348 ] {a40bf066-0131-453b-b948-565fcd59755d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1126995 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59554) (comment: 02124_insert_deduplication_token_multiple_blocks.sh) (in query: INSERT INTO block_dedup_token VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:0: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f767d in /usr/bin/clickhouse

2024.09.24 02:43:24.812523 [ 22366 ] {3d37ccd8-977b-4db5-92b4-57c754484608} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52252) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:43:24.812795 [ 22353 ] {212a0806-36c1-495a-97c4-eea861eff11c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1064928 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52220) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:26.054013 [ 22360 ] {82b2d436-234b-4418-8d93-5cd9970285e2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52190) (comment: 00141_transform.sql) (in query: SELECT transform(SearchEngineID, [2, 3], ['Яндекс', 'Google'], 'Остальные') AS title, count() AS c FROM test.hits WHERE SearchEngineID != 0 GROUP BY title HAVING c > 0 ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:26.054013 [ 22358 ] {a4175dbd-0603-4ed4-ab8a-56f40fff9488} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 270 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:46258) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:43:26.054056 [ 22334 ] {4808c9a7-7251-4655-bc79-b89a08d424a2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1149592 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52246) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSV), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:43:26.668507 [ 22325 ] {8306aaf9-c266-4433-a423-861a4506a976} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing ConvertingAggregatedToChunksTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:35372) (comment: 00172_hits_joins.gen.sql) (in query: SELECT EventDate, count() AS hits, any(visits) FROM test.hits ANY LEFT JOIN ( SELECT StartDate AS EventDate, sum(Sign) AS visits FROM test.visits GROUP BY EventDate ) USING EventDate GROUP BY EventDate ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:2654: void DB::Aggregator::mergeSingleLevelDataImpl<DB::AggregationMethodOneNumber<unsigned short, FixedHashMap<unsigned short, char*, FixedHashMapImplicitZeroCell<unsigned short, char*, HashTableNoState>, FixedHashTableStoredSize<FixedHashMapImplicitZeroCell<unsigned short, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(std::vector<std::shared_ptr<DB::AggregatedDataVariants>, std::allocator<std::shared_ptr<DB::AggregatedDataVariants>>>&) const @ 0x0000000037e7caa5 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::ConvertingAggregatedToChunksTransform::mergeSingleLevel() @ 0x000000003eb2f766 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:308: DB::ConvertingAggregatedToChunksTransform::work() @ 0x000000003eb2709c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:27.568489 [ 2397 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:27.568469 [ 2430 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:27.568597 [ 22335 ] {06b025fc-b33b-4feb-9eae-26d16881b5e1} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1049065 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: test/bui/zjjwczeptylsabivryovcmnspizhv, hash key: bdcffa64dac9120850af308fc3f18caf, file_offset_of_buffer_end: 0, read_until_position: 70, internal buffer end: 70, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 06b025fc-b33b-4feb-9eae-26d16881b5e1:3198, file segment info: File segment: [0, 69], key: bdcffa64dac9120850af308fc3f18caf, state: DOWNLOADING, downloaded size: 0, reserved size: 70, downloader id: 06b025fc-b33b-4feb-9eae-26d16881b5e1:3198, current write offset: 0, caller id: 06b025fc-b33b-4feb-9eae-26d16881b5e1:3198, kind: Regular, unbound: 0: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52204) (comment: 01646_fix_window_funnel_inconistency.sql) (in query: SELECT level, count() AS c FROM ( SELECT user_id, windowFunnel(6048000000000000)(timestamp, eventID = 1004, eventID = 1003, eventID = 1002) AS level FROM trend GROUP BY user_id ) GROUP BY level ORDER BY level ASC;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x00000000357922d0 in /usr/bin/clickhouse
20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a6245 in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad0b7 in /usr/bin/clickhouse
22. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
23. ./build_docker/./src/IO/ReadBuffer.h:0: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x000000003d3f7b44 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeMarksLoader.cpp:0: DB::MergeTreeMarksLoader::loadMarks() @ 0x000000003d3f4fcd in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:0: std::__packaged_task_func<std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr<DB::MarksInCompressedFile> ()>::operator()() @ 0x000000003d3fc142 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<std::shared_ptr<DB::MarksInCompressedFile> ()>::operator()() @ 0x000000003d4035e1 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003d3fc46e in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse

2024.09.24 02:43:27.568587 [ 22363 ] {cfdf0b69-a17b-4bd1-b02d-f5796f284419} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.056698511 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:197: DB::PipelineExecutor::finalizeExecution() @ 0x000000003e1fb852 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb16a in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:27.568814 [ 22348 ] {a40bf066-0131-453b-b948-565fcd59755d} <Error> DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1126995 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:0: DB::CompletedPipelineExecutor::execute() @ 0x000000003e1f767d in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:27.568908 [ 22366 ] {3d37ccd8-977b-4db5-92b4-57c754484608} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:43:27.569008 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5107423 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:27.568940 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4201724 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:27.569055 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4217279 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:27.569132 [ 22353 ] {212a0806-36c1-495a-97c4-eea861eff11c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1064928 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:27.569253 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 4267260 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.034095 [ 22342 ] {41fbb3cf-62d0-413b-8704-d391ac5a9c0f} <Error> executeQuery: Code: 36. DB::Exception: StorageExecutable argument "foobar" is invalid query. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43530) (comment: 02517_executable_pool_bad_input_query.sql) (in query: CREATE TABLE test_table (value String) ENGINE=ExecutablePool('nonexist.py', 'TabSeparated', (foobar));), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageExecutable.cpp:199: DB::registerStorageExecutable(DB::StorageFactory&)::$_1::operator()(DB::StorageFactory::Arguments const&, bool) const @ 0x000000003bc0585c in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerStorageExecutable(DB::StorageFactory&)::$_2, std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x000000003bc06fdf in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.034175 [ 22322 ] {c8b4c822-829e-434d-9d50-1f4ebc4807d8} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.192127196 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37584) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.034170 [ 22323 ] {a7ed3547-181a-47b7-a495-42863c615308} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.192383907 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:50180) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.034222 [ 22358 ] {a4175dbd-0603-4ed4-ab8a-56f40fff9488} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 270 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:43:29.034204 [ 22360 ] {82b2d436-234b-4418-8d93-5cd9970285e2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.034268 [ 22337 ] {3b5dfb39-3f0a-4e23-ad1a-074d3278e1d9} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.172025979 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:34548) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.034405 [ 22334 ] {4808c9a7-7251-4655-bc79-b89a08d424a2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 1149592 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:43:29.034793 [ 22335 ] {06b025fc-b33b-4feb-9eae-26d16881b5e1} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1049065 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: test/bui/zjjwczeptylsabivryovcmnspizhv, hash key: bdcffa64dac9120850af308fc3f18caf, file_offset_of_buffer_end: 0, read_until_position: 70, internal buffer end: 70, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 06b025fc-b33b-4feb-9eae-26d16881b5e1:3198, file segment info: File segment: [0, 69], key: bdcffa64dac9120850af308fc3f18caf, state: DOWNLOADING, downloaded size: 0, reserved size: 70, downloader id: 06b025fc-b33b-4feb-9eae-26d16881b5e1:3198, current write offset: 0, caller id: 06b025fc-b33b-4feb-9eae-26d16881b5e1:3198, kind: Regular, unbound: 0: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x00000000357922d0 in /usr/bin/clickhouse
20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a6245 in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad0b7 in /usr/bin/clickhouse
22. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
23. ./build_docker/./src/IO/ReadBuffer.h:0: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x000000003d3f7b44 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeMarksLoader.cpp:0: DB::MergeTreeMarksLoader::loadMarks() @ 0x000000003d3f4fcd in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:0: std::__packaged_task_func<std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr<DB::MarksInCompressedFile> ()>::operator()() @ 0x000000003d3fc142 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<std::shared_ptr<DB::MarksInCompressedFile> ()>::operator()() @ 0x000000003d4035e1 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003d3fc46e in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse

2024.09.24 02:43:29.034945 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4218943 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.034987 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.035040 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.034978 [ 2369 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.034513 [ 22325 ] {8306aaf9-c266-4433-a423-861a4506a976} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.52 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing ConvertingAggregatedToChunksTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:2654: void DB::Aggregator::mergeSingleLevelDataImpl<DB::AggregationMethodOneNumber<unsigned short, FixedHashMap<unsigned short, char*, FixedHashMapImplicitZeroCell<unsigned short, char*, HashTableNoState>, FixedHashTableStoredSize<FixedHashMapImplicitZeroCell<unsigned short, char*, HashTableNoState>>, Allocator<true, true>>, false, false>>(std::vector<std::shared_ptr<DB::AggregatedDataVariants>, std::allocator<std::shared_ptr<DB::AggregatedDataVariants>>>&) const @ 0x0000000037e7caa5 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::ConvertingAggregatedToChunksTransform::mergeSingleLevel() @ 0x000000003eb2f766 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:308: DB::ConvertingAggregatedToChunksTransform::work() @ 0x000000003eb2709c in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.035270 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1150872 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.036688 [ 22342 ] {41fbb3cf-62d0-413b-8704-d391ac5a9c0f} <Error> TCPHandler: Code: 36. DB::Exception: StorageExecutable argument "foobar" is invalid query. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageExecutable.cpp:199: DB::registerStorageExecutable(DB::StorageFactory&)::$_1::operator()(DB::StorageFactory::Arguments const&, bool) const @ 0x000000003bc0585c in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerStorageExecutable(DB::StorageFactory&)::$_2, std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x000000003bc06fdf in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.039168 [ 22358 ] {a4175dbd-0603-4ed4-ab8a-56f40fff9488} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:43:29.034435 [ 22367 ] {50bc776d-ae27-495c-99d1-3644a2ef4e89} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.56799428 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:52292) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.048724 [ 22322 ] {c8b4c822-829e-434d-9d50-1f4ebc4807d8} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.192127196 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.049266 [ 22337 ] {3b5dfb39-3f0a-4e23-ad1a-074d3278e1d9} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.172025979 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.052103 [ 22323 ] {a7ed3547-181a-47b7-a495-42863c615308} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.192383907 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.061385 [ 22323 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:50180). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.064519 [ 22337 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:34548). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.067879 [ 22322 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:37584). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:29.135522 [ 22363 ] {cfdf0b69-a17b-4bd1-b02d-f5796f284419} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:43:29.152640 [ 22342 ] {b2bf9062-3340-41f6-b7e0-71801285ce0d} <Error> executeQuery: Code: 36. DB::Exception: StorageExecutable argument "'(SELECT 1)'" is invalid query. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43530) (comment: 02517_executable_pool_bad_input_query.sql) (in query: CREATE TABLE test_table (value String) ENGINE=ExecutablePool('nonexist.py', 'TabSeparated', '(SELECT 1)');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageExecutable.cpp:199: DB::registerStorageExecutable(DB::StorageFactory&)::$_1::operator()(DB::StorageFactory::Arguments const&, bool) const @ 0x000000003bc0585c in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerStorageExecutable(DB::StorageFactory&)::$_2, std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x000000003bc06fdf in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.155422 [ 22342 ] {b2bf9062-3340-41f6-b7e0-71801285ce0d} <Error> TCPHandler: Code: 36. DB::Exception: StorageExecutable argument "'(SELECT 1)'" is invalid query. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageExecutable.cpp:199: DB::registerStorageExecutable(DB::StorageFactory&)::$_1::operator()(DB::StorageFactory::Arguments const&, bool) const @ 0x000000003bc0585c in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerStorageExecutable(DB::StorageFactory&)::$_2, std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x000000003bc06fdf in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.172306 [ 22342 ] {37b386b1-a17f-4135-9061-e14f1c2eecf5} <Error> executeQuery: Code: 36. DB::Exception: StorageExecutable argument "[1, 2, 3]" is invalid query. (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43530) (comment: 02517_executable_pool_bad_input_query.sql) (in query: CREATE TABLE test_table (value String) ENGINE=ExecutablePool('nonexist.py', 'TabSeparated', [1,2,3]);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageExecutable.cpp:199: DB::registerStorageExecutable(DB::StorageFactory&)::$_1::operator()(DB::StorageFactory::Arguments const&, bool) const @ 0x000000003bc0585c in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerStorageExecutable(DB::StorageFactory&)::$_2, std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x000000003bc06fdf in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.174044 [ 22342 ] {37b386b1-a17f-4135-9061-e14f1c2eecf5} <Error> TCPHandler: Code: 36. DB::Exception: StorageExecutable argument "[1, 2, 3]" is invalid query. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageExecutable.cpp:199: DB::registerStorageExecutable(DB::StorageFactory&)::$_1::operator()(DB::StorageFactory::Arguments const&, bool) const @ 0x000000003bc0585c in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<DB::registerStorageExecutable(DB::StorageFactory&)::$_2, std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x000000003bc06fdf in /usr/bin/clickhouse
5. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:29.262842 [ 22367 ] {50bc776d-ae27-495c-99d1-3644a2ef4e89} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.56799428 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:30.037698 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:30.045300 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930318 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 4195133 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930383 [ 2332 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930447 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930650 [ 22326 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930821 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 5099727 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930886 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 4241593 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c44aff in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930929 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 4218047 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930978 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1153408 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_55_60_1/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1563): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::SerializationNamed::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036f6f42c in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationTuple.cpp:0: DB::SerializationTuple::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003703366c in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/SerializationMap.cpp:363: DB::SerializationMap::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036f6dcad in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930982 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 4256636 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.930810 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1180823 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column URLDomain): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43572) (comment: 00153_aggregate_arena_race.sql) (in query: insert into dest00153 select groupUniqArrayState(RefererDomain) from test.hits group by URLDomain;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:43:35.931088 [ 22322 ] {9a06d9d9-b341-4ed2-803f-543ef134deed} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43672) (comment: 01591_window_functions.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:35.931345 [ 22333 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.931803 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 4317477 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.932004 [ 22327 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.932901 [ 22322 ] {9a06d9d9-b341-4ed2-803f-543ef134deed} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:35.941187 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1050750 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:72: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f86a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.945602 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_93_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1079295 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressionCodecMultiple::doCompressData(char const*, unsigned int, char*) const @ 0x00000000368e1f73 in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/ICompressionCodec.cpp:89: DB::ICompressionCodec::compress(char const*, unsigned int, char*) const @ 0x00000000369cf862 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:39: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b01e8 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.947012 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 2762273, read_until_position: 2833854, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6671, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6671, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6671, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.950349 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.952627 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 3266050, read_until_position: 3378408, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3304, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3304, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3304, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.957023 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 2527817, read_until_position: 2762273, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3061, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3061, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3061, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.961659 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 2291990, read_until_position: 2527817, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:2986, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:2986, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:2986, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.970004 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 2243956, read_until_position: 2291990, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3091, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3091, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3091, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:35.985551 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1411454 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.015647 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 2094571, read_until_position: 2243956, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3090, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3090, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3090, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.036093 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 1905433, read_until_position: 2111818, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3079, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3079, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3079, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.047036 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 1693393, read_until_position: 1905433, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3059, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3059, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3059, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.054859 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 1455942, read_until_position: 1693393, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3547, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3547, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3547, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.061257 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 1404977, read_until_position: 1467050, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6333, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6333, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6333, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.074260 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 1241788, read_until_position: 1404977, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3316, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3316, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3316, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.088278 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 997397, read_until_position: 1241788, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3006, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3006, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3006, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.097295 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 718902, read_until_position: 997397, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3069, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3069, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3069, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.102431 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 461876, read_until_position: 718902, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3342, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3342, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3342, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.107548 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 202619, read_until_position: 461876, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:2835, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:2835, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:2835, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.116459 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/soq/inxqbfqtdyfvziupnosrvptbhwodh, hash key: 738f24baaf03d46ea04531a47b66f36f, file_offset_of_buffer_end: 0, read_until_position: 202619, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:2849, file segment info: File segment: [0, 2833853], key: 738f24baaf03d46ea04531a47b66f36f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:2849, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:2849, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
23. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.164779 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 3586577, read_until_position: 3869948, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3238, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3238, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3238, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.181496 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 3352651, read_until_position: 3586577, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6823, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6823, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6823, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.187932 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 3096613, read_until_position: 3352651, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6909, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6909, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6909, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.193996 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 2871441, read_until_position: 3096613, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6842, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6842, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6842, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.399468 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 2611027, read_until_position: 2871441, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:2998, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:2998, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:2998, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.403455 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 2355058, read_until_position: 2611027, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6795, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6795, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6795, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.406450 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 2113867, read_until_position: 2355058, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3285, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3285, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3285, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.409301 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 1864239, read_until_position: 2113867, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6836, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6836, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6836, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.414449 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 1400085, read_until_position: 1642734, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3282, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3282, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3282, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.526540 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 675061, read_until_position: 883838, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:2846, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:2846, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:2846, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.530518 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/bqn/qspflezayytmsljfypxyvbgxqwjgj, hash key: 94c2dd39719a846282c426ea6ac1c6f9, file_offset_of_buffer_end: 519702, read_until_position: 675061, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3097, file segment info: File segment: [0, 3869947], key: 94c2dd39719a846282c426ea6ac1c6f9, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3097, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3097, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.622616 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_93_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1051207 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.755516 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 3044821, read_until_position: 3266050, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3339, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3339, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3339, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.812326 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 2801299, read_until_position: 3044821, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6759, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6759, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6759, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.842697 [ 2540 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmpa4f96f76-4ba5-4b20-953b-51275faa9ba3' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:43:36.843571 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 2564824, read_until_position: 2822659, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6324, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6324, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6324, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.857252 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.857689 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 2326285, read_until_position: 2564824, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6621, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6621, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6621, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.874019 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.881244 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1373215 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.882487 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.65 GiB (attempt to allocate chunk of 4195973 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned short, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208b42fb in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.h:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnVector<unsigned short>::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b49733f in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/ColumnVector.cpp:729: DB::ColumnVector<unsigned short>::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b299205 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPartWriter.cpp:0: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d135ce2 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:166: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11e92d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4063f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.931479 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.931542 [ 2366 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.968206 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 1775493, read_until_position: 2049992, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:2982, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:2982, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:2982, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.979909 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 975935, read_until_position: 1252333, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3247, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3247, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3247, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.986464 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 418251, read_until_position: 721350, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:6867, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:6867, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:6867, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.989462 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 253387, read_until_position: 418251, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3310, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3310, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3310, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:36.992515 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ern/ouhwlwwepsczpedqamxpcpqjuutnb, hash key: 6c992308159b142c297638bb7e96c99f, file_offset_of_buffer_end: 0, read_until_position: 253387, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6c9654a8-0c91-48b5-8913-9273641692e6:3056, file segment info: File segment: [0, 3378407], key: 6c992308159b142c297638bb7e96c99f, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6c9654a8-0c91-48b5-8913-9273641692e6:3056, current write offset: 0, caller id: 6c9654a8-0c91-48b5-8913-9273641692e6:3056, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
23. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:37.109775 [ 22335 ] {6c9654a8-0c91-48b5-8913-9273641692e6} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1180823 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column URLDomain): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:43:38.062367 [ 2532 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp8310ec5d-0c2e-46fd-a8de-d56daa862437' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:43:38.306422 [ 22337 ] {924247b5-3f56-4e32-9774-65e23113dc3d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43648) (comment: 02024_join_on_or_long.gen.sql) (in query: CREATE TABLE t2 (`key` Int32, `val` Int64) ENGINE = MergeTree ORDER BY key SETTINGS index_granularity = 48536, min_bytes_for_wide_part = 406892946, ratio_of_defaults_for_sparse_serialization = 0.18411360681056976, merge_max_block_size = 8594, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 3268562, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 78226, primary_key_compress_block_size = 51818), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:43:38.306602 [ 22323 ] {5203e9f6-ab36-44bc-bb39-0f76504e3cfe} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1432626 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37598) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:43:38.306520 [ 22348 ] {26779646-acca-4570-b775-0c8d557c4d7d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1059005 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35762) (comment: 02124_insert_deduplication_token_multiple_blocks.sh) (in query: INSERT INTO block_dedup_token VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:243: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669f95 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse

2024.09.24 02:43:38.306737 [ 22363 ] {bef8ff05-3491-4c5d-9439-eb53e5aaf516} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47368) (comment: 02377_modify_column_from_lc.sql) (in query: CREATE TABLE t_modify_from_lc_1 (`id` UInt64, `a` LowCardinality(UInt32) CODEC(NONE)) ENGINE = MergeTree ORDER BY tuple() SETTINGS min_bytes_for_wide_part = 0, index_granularity = 8192, index_granularity_bytes = '10Mi', ratio_of_defaults_for_sparse_serialization = 0.7225622534751892, merge_max_block_size = 8522, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 10737418240, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 69753, primary_key_compress_block_size = 60945), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:43:39.321055 [ 22358 ] {7381bd63-1cbb-4ec1-817b-2b4d14b6e3ed} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.247995451 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43610) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:39.321111 [ 22366 ] {dd00a0d9-a4ab-4ae2-9600-b746be6a9145} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:50188) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:39.321112 [ 22334 ] {c7075e2e-1f02-4367-a643-d54afdeb6329} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.67 GiB (attempt to allocate chunk of 1065056 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43568) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSVWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:39.321164 [ 22325 ] {f7d6409f-94a7-4309-a8aa-7150d12e84b9} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43620) (comment: 00022_merge_prewhere.sql) (in query: SELECT count() FROM test.merge_hits PREWHERE AdvEngineID = 2;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:39.321335 [ 2386 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:39.321393 [ 2433 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:39.321402 [ 22353 ] {182621db-f84a-45eb-993d-e0d635b51dde} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:34558) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:39.321365 [ 22367 ] {34ed0e7a-095e-417f-b504-3e2c0f9fa296} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37680) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:39.321667 [ 22322 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:39.321694 [ 22363 ] {bef8ff05-3491-4c5d-9439-eb53e5aaf516} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:43:39.321677 [ 22337 ] {924247b5-3f56-4e32-9774-65e23113dc3d} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse

2024.09.24 02:43:39.321942 [ 22348 ] {26779646-acca-4570-b775-0c8d557c4d7d} <Error> DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1059005 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:243: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669f95 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:39.321680 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_93_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1051207 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:39.321881 [ 22323 ] {5203e9f6-ab36-44bc-bb39-0f76504e3cfe} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1432626 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:43:40.715359 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4194556 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66cdfe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:40.715778 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:40.715878 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1373215 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:40.715889 [ 22323 ] {5203e9f6-ab36-44bc-bb39-0f76504e3cfe} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:43:40.715950 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:41.357727 [ 22366 ] {dd00a0d9-a4ab-4ae2-9600-b746be6a9145} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50188). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:41.357732 [ 22358 ] {7381bd63-1cbb-4ec1-817b-2b4d14b6e3ed} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.247995451 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:41.357865 [ 22325 ] {f7d6409f-94a7-4309-a8aa-7150d12e84b9} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:41.357888 [ 22367 ] {34ed0e7a-095e-417f-b504-3e2c0f9fa296} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:37680). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:41.357948 [ 22334 ] {c7075e2e-1f02-4367-a643-d54afdeb6329} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.67 GiB (attempt to allocate chunk of 1065056 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:41.357888 [ 22353 ] {182621db-f84a-45eb-993d-e0d635b51dde} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:34558). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:41.358076 [ 2346 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:41.358145 [ 2396 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:41.358280 [ 22366 ] {dd00a0d9-a4ab-4ae2-9600-b746be6a9145} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:41.358470 [ 22367 ] {34ed0e7a-095e-417f-b504-3e2c0f9fa296} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:41.358736 [ 22353 ] {182621db-f84a-45eb-993d-e0d635b51dde} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:41.359462 [ 22366 ] {dd00a0d9-a4ab-4ae2-9600-b746be6a9145} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:43:41.359715 [ 22353 ] {182621db-f84a-45eb-993d-e0d635b51dde} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:43:41.360193 [ 22367 ] {34ed0e7a-095e-417f-b504-3e2c0f9fa296} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:43:43.474117 [ 2412 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:43.474151 [ 22325 ] {93d11e18-6f79-49d0-bd06-bcc2541e4216} <Error> executeQuery: Code: 36. DB::Exception: Value of width must not be NaN and Inf: While processing greatCircleAngle(1048575, 257, -9223372036854775808, 1048576) - NULL, bar(7, -inf, 1024). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47522) (comment: 01774_bar_with_illegal_value.sql) (in query: SELECT greatCircleAngle(1048575, 257, -9223372036854775808, 1048576) - NULL, bar(7, -inf, 1024);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [39]>(int, char const (&) [39]) @ 0x000000000ca07b77 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ca062f7 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:43:43.474209 [ 2356 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:53.005013 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4195133 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:53.005048 [ 22325 ] {93d11e18-6f79-49d0-bd06-bcc2541e4216} <Error> TCPHandler: Code: 36. DB::Exception: Value of width must not be NaN and Inf: While processing greatCircleAngle(1048575, 257, -9223372036854775808, 1048576) - NULL, bar(7, -inf, 1024). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [39]>(int, char const (&) [39]) @ 0x000000000ca07b77 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ca062f7 in /usr/bin/clickhouse
4. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse

2024.09.24 02:43:53.005134 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4194812 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:53.005234 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 5080191 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:53.005403 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:55.330731 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4198137 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned int, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long) @ 0x00000000208b817b in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnVector.h:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnVector<unsigned int>::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b4ced1f in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/ColumnVector.cpp:729: DB::ColumnVector<unsigned int>::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b2b2926 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPartWriter.cpp:0: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d135ce2 in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:166: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11e92d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4063f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:55.330798 [ 2333 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:55.330893 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:55.330899 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4746525 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:55.331055 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4365948 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:55.331288 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_93_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:57.304746 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 5156673 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:57.304771 [ 22353 ] {5f5db10d-fd6a-4faf-9e38-6eedc013488d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1159424 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: while executing 'FUNCTION toString(intDiv(modulo(number, 10000), 10) :: 3) -> toString(intDiv(modulo(number, 10000), 10)) String : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47486) (comment: 00375_shard_group_uniq_array_of_string.sql) (in query: CREATE TABLE group_uniq_str ENGINE = Memory AS SELECT number % 10 as id, toString(intDiv((number%10000), 10)) as v FROM system.numbers LIMIT 10000000;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. DB::WriteBufferFromVector<DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>>::nextImpl() @ 0x0000000009434d4b in /usr/bin/clickhouse
11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
12. void DB::detail::writeUIntTextFallback<unsigned short>(unsigned short, DB::WriteBuffer&) @ 0x0000000009f328c2 in /usr/bin/clickhouse
13. DB::ConvertImpl<DB::DataTypeNumber<unsigned short>, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) @ 0x0000000009f31e78 in /usr/bin/clickhouse
14. bool DB::callOnIndexAndDataType<DB::DataTypeString, DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009f2a7b2 in /usr/bin/clickhouse
15. DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009f27f3f in /usr/bin/clickhouse
16. DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009f26862 in /usr/bin/clickhouse
17. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
18. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
19. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
20. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:43:57.304882 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 4216767 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:57.304867 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_129_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 2084990 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:57.305319 [ 22363 ] {0df7a3e6-e5c3-492b-a1df-8a0e03403a22} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47452) (comment: 00146_summing_merge_tree_nested_map.sql) (in query: optimize table nested_map;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.h:104: DB::StorageMergeTree::merge(bool, String const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::MergeTreeTransaction> const&, String&, bool) @ 0x000000003da40f6f in /usr/bin/clickhouse

2024.09.24 02:43:57.305346 [ 22337 ] {94e31ab6-b10f-4199-b9b7-eaca4a38ca69} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1949696 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (avg_value_size_hint = 114.67141723632812, avg_chars_size = 128.00570068359374, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47478) (comment: 00095_hyperscan_profiler.sql) (in query: SELECT count() FROM test.hits WHERE multiFuzzyMatchAny(URL, 2, ['about/address', 'for_woman', '^https?://lm-company.ruy/$', 'ultimateguitar.com']);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:57.305581 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1050750 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:72: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f86a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:167: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000003700474d in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:57.305602 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:57.944346 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp7607f522-bc49-4ed4-8298-03c264e2c397' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:43:58.165064 [ 22335 ] {7c39ec6a-3139-45dc-8185-d38ba636a42f} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 7.439972937 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33306) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:58.165067 [ 24260 ] {4bf8d256-30b0-4e1c-984d-05d476a23bfc} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 6.639975848 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43820) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:58.165131 [ 22333 ] {4df4b827-643a-4e1d-98ff-64b8f72e07ed} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1096591 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column EventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47434) (comment: 00167_read_bytes_from_fs.sql) (in query: SELECT sum(cityHash64(*)) FROM test.hits SETTINGS max_threads=40;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:58.165232 [ 22324 ] {3d0457c0-51b7-43f7-bc99-ab4ef6b92122} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48242) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:58.165403 [ 24259 ] {aa7925d2-dc82-41c3-af90-76a953aacc57} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48960) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:58.165724 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1049407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:58.165890 [ 22342 ] {3b5a263f-94c1-40b7-a084-ab6d0450cbf2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:38272) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:59.081968 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.082044 [ 22358 ] {daad025a-1403-43c1-a436-07bb17cfa22a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47488) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:59.082072 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.082042 [ 22367 ] {8cb225a9-6024-418b-bb62-03fe9a26463a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1184181 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47510) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSVWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse

2024.09.24 02:43:59.082193 [ 22363 ] {0df7a3e6-e5c3-492b-a1df-8a0e03403a22} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.h:104: DB::StorageMergeTree::merge(bool, String const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::MergeTreeTransaction> const&, String&, bool) @ 0x000000003da40f6f in /usr/bin/clickhouse

2024.09.24 02:43:59.082293 [ 22337 ] {94e31ab6-b10f-4199-b9b7-eaca4a38ca69} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1949696 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (avg_value_size_hint = 114.67141723632812, avg_chars_size = 128.00570068359374, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:59.082247 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1189512 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.082445 [ 24260 ] {4bf8d256-30b0-4e1c-984d-05d476a23bfc} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 6.639975848 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:59.082272 [ 22353 ] {5f5db10d-fd6a-4faf-9e38-6eedc013488d} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1159424 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: while executing 'FUNCTION toString(intDiv(modulo(number, 10000), 10) :: 3) -> toString(intDiv(modulo(number, 10000), 10)) String : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. DB::WriteBufferFromVector<DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>>::nextImpl() @ 0x0000000009434d4b in /usr/bin/clickhouse
11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
12. void DB::detail::writeUIntTextFallback<unsigned short>(unsigned short, DB::WriteBuffer&) @ 0x0000000009f328c2 in /usr/bin/clickhouse
13. DB::ConvertImpl<DB::DataTypeNumber<unsigned short>, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) @ 0x0000000009f31e78 in /usr/bin/clickhouse
14. bool DB::callOnIndexAndDataType<DB::DataTypeString, DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x0000000009f2a7b2 in /usr/bin/clickhouse
15. DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeInternal(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009f27f3f in /usr/bin/clickhouse
16. DB::FunctionConvert<DB::DataTypeString, DB::NameToString, DB::ToStringMonotonicity>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000009f26862 in /usr/bin/clickhouse
17. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6478 in /usr/bin/clickhouse
18. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c021d in /usr/bin/clickhouse
19. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
20. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:124: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000037c59b21 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000003eba281b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:43:59.082597 [ 24259 ] {aa7925d2-dc82-41c3-af90-76a953aacc57} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:59.082640 [ 22335 ] {7c39ec6a-3139-45dc-8185-d38ba636a42f} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 7.439972937 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:43:59.082724 [ 22324 ] {3d0457c0-51b7-43f7-bc99-ab4ef6b92122} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:59.082763 [ 22342 ] {3b5a263f-94c1-40b7-a084-ab6d0450cbf2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:59.082914 [ 22333 ] {4df4b827-643a-4e1d-98ff-64b8f72e07ed} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/tqr/kjdjwhepgxqrnvmnzzfurzqsmlzvq, hash key: 200be743987baca862e5804edad64823, file_offset_of_buffer_end: 26663, read_until_position: 28421, internal buffer end: 29886, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6862, file segment info: File segment: [0, 29885], key: 200be743987baca862e5804edad64823, state: DOWNLOADING, downloaded size: 0, reserved size: 26663, downloader id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6862, current write offset: 0, caller id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6862, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.087300 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_93_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1051207 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.088491 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.090106 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_129_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1110623 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.093712 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.111360 [ 24259 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:48960). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.121671 [ 22335 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:33306). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.122434 [ 24260 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:43820). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.139309 [ 22324 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:48242). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.147367 [ 22342 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:38272). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.154093 [ 22348 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.301523 [ 22358 ] {daad025a-1403-43c1-a436-07bb17cfa22a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:43:59.461400 [ 22367 ] {8cb225a9-6024-418b-bb62-03fe9a26463a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1184181 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse

2024.09.24 02:43:59.603057 [ 22333 ] {4df4b827-643a-4e1d-98ff-64b8f72e07ed} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/tqr/kjdjwhepgxqrnvmnzzfurzqsmlzvq, hash key: 200be743987baca862e5804edad64823, file_offset_of_buffer_end: 6153, read_until_position: 8204, internal buffer end: 29886, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6091, file segment info: File segment: [0, 29885], key: 200be743987baca862e5804edad64823, state: DOWNLOADING, downloaded size: 0, reserved size: 6153, downloader id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6091, current write offset: 0, caller id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6091, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.621539 [ 22333 ] {4df4b827-643a-4e1d-98ff-64b8f72e07ed} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/hxp/lnjymhlxolgfdknymdmjhbliolnzy, hash key: 788b6fb559c4a12a0df09452cd5b1e39, file_offset_of_buffer_end: 10703, read_until_position: 41542, internal buffer end: 395831, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:3320, file segment info: File segment: [0, 395830], key: 788b6fb559c4a12a0df09452cd5b1e39, state: DOWNLOADING, downloaded size: 0, reserved size: 10703, downloader id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:3320, current write offset: 0, caller id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:3320, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.626349 [ 22333 ] {4df4b827-643a-4e1d-98ff-64b8f72e07ed} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/vul/gyywtbklrwldinrtwlhkxatezigiu, hash key: d6ffec6a82ea258c339b3ef00e040c80, file_offset_of_buffer_end: 23920, read_until_position: 64875, internal buffer end: 501908, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6665, file segment info: File segment: [0, 501907], key: d6ffec6a82ea258c339b3ef00e040c80, state: DOWNLOADING, downloaded size: 0, reserved size: 23920, downloader id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6665, current write offset: 0, caller id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6665, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.630841 [ 22333 ] {4df4b827-643a-4e1d-98ff-64b8f72e07ed} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/tqr/kjdjwhepgxqrnvmnzzfurzqsmlzvq, hash key: 200be743987baca862e5804edad64823, file_offset_of_buffer_end: 4102, read_until_position: 6153, internal buffer end: 29886, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6131, file segment info: File segment: [0, 29885], key: 200be743987baca862e5804edad64823, state: DOWNLOADING, downloaded size: 0, reserved size: 4102, downloader id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6131, current write offset: 0, caller id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6131, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.692075 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:43:59.769059 [ 22333 ] {4df4b827-643a-4e1d-98ff-64b8f72e07ed} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/tqr/kjdjwhepgxqrnvmnzzfurzqsmlzvq, hash key: 200be743987baca862e5804edad64823, file_offset_of_buffer_end: 0, read_until_position: 2051, internal buffer end: 29886, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6790, file segment info: File segment: [0, 29885], key: 200be743987baca862e5804edad64823, state: DOWNLOADING, downloaded size: 0, reserved size: 29886, downloader id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6790, current write offset: 0, caller id: 4df4b827-643a-4e1d-98ff-64b8f72e07ed:6790, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
23. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:00.084259 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:00.086112 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:00.612740 [ 24259 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:00.889459 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_93_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:00.889665 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:02.735899 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 4199802 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:37: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11cab1 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:02.736067 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 4994103 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:02.736200 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1765555 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_2_2_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6553): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:02.736280 [ 22333 ] {4df4b827-643a-4e1d-98ff-64b8f72e07ed} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1096591 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column EventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:02.736318 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_129_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1050750 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:72: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f86a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:02.736435 [ 2345 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:02.736511 [ 2443 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:02.736591 [ 24259 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:02.736851 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 4278134 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:03.431683 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp282ce75e-9b37-4cf6-af19-9d36493065bd' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:04.616188 [ 22348 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.616301 [ 22337 ] {5defcc94-939b-4b17-a776-7ce871a5c983} <Error> executeQuery: Code: 407. DB::Exception: Decimal math overflow: While processing makeDateTime64(2299, 12, 31, 23, 59, 59, 999999999, 9, 'UTC'). (DECIMAL_OVERFLOW) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57524) (comment: 02245_make_datetime64.sql) (in query: select makeDateTime64(2299, 12, 31, 23, 59, 59, 999999999, 9, 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [22]>(int, char const (&) [22]) @ 0x000000000947da37 in /usr/bin/clickhouse
3. DB::DateTime64 DB::DecimalUtils::decimalFromComponents<DB::DateTime64>(DB::DateTime64::NativeType const&, DB::DateTime64::NativeType const&, unsigned int) @ 0x000000000948fd5e in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000171a7331 in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:44:04.616555 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.616596 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 4331388 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.616586 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_93_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1051207 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.616642 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1049407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.616645 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1373215 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.616689 [ 24259 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.616910 [ 2356 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.616724 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.650908 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_130_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1118431 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.657591 [ 22337 ] {5defcc94-939b-4b17-a776-7ce871a5c983} <Error> TCPHandler: Code: 407. DB::Exception: Decimal math overflow: While processing makeDateTime64(2299, 12, 31, 23, 59, 59, 999999999, 9, 'UTC'). (DECIMAL_OVERFLOW), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [22]>(int, char const (&) [22]) @ 0x000000000947da37 in /usr/bin/clickhouse
3. DB::DateTime64 DB::DecimalUtils::decimalFromComponents<DB::DateTime64>(DB::DateTime64::NativeType const&, DB::DateTime64::NativeType const&, unsigned int) @ 0x000000000948fd5e in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000171a7331 in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:44:04.679526 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:04.696078 [ 22324 ] {9a869787-8fee-4248-9e14-bca9c993797b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1200703 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37820) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:05.420514 [ 2537 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp555e9091-d5c7-4617-8385-7874a03c3aa7' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:07.073209 [ 22325 ] {b64361dc-c610-4e8d-8d23-0625970b090f} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1200703 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:50528) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:07.073216 [ 22334 ] {fe645ab5-20ad-4869-a605-5c90a6dc110b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1091080 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:47920) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e84f0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:07.073209 [ 22332 ] {9320f406-5bc0-43ab-9284-8ccc51fd640a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1091080 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:36754) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e84f0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:07.073269 [ 22347 ] {f7800e6b-9c27-464c-bf08-4be1f7813bee} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1096456 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48956) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e84f0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:07.816002 [ 22367 ] {c72a4bf5-56e8-4444-ae84-59f5bcc1053d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1069998 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingInOrderTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57512) (comment: 00082_quantiles.sql) (in query: SELECT CounterID AS k, quantileExact(0.5)(ResolutionWidth) FROM test.hits GROUP BY k ORDER BY count() DESC, CounterID LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:322: DB::Aggregator::addSingleKeyToAggregateColumns(DB::AggregatedDataVariants&, std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&) const @ 0x0000000037dfb89d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingInOrderTransform.cpp:0: DB::AggregatingInOrderTransform::consume(DB::Chunk) @ 0x000000003f054ae1 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/AggregatingInOrderTransform.cpp:0: DB::AggregatingInOrderTransform::work() @ 0x000000003f059c1e in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:07.816208 [ 24260 ] {53530bd0-ec0d-4036-953c-5045858e1ae0} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57532) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:44:09.056031 [ 22322 ] {dac44a4c-3872-4f05-81ea-5e5a7b02c0b4} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1068096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:38258) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:09.056102 [ 22360 ] {2fbe8798-972d-469a-aaf3-a2169213e3b3} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1068096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60922) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:09.056159 [ 22341 ] {fc607c76-5de4-479b-a247-a946c9a4446b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1071288 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43812) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:09.056102 [ 22327 ] {bc066051-b20c-4834-aad7-4b3563ed9f57} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1068096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51392) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:10.611339 [ 22369 ] {60143b9b-e3a2-4728-a2c2-a0e9293ef231} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1096447 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33298) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b34a246 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:478: DB::MergeTreeRangeReader::ReadResult::applyFilter(DB::FilterWithCachedCount const&) @ 0x000000003d50c229 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::MergeTreeRangeReader::ReadResult::optimize(DB::FilterWithCachedCount const&, bool) @ 0x000000003d512fd0 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1388: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x000000003d52e672 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1074: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d524de4 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:10.611455 [ 22324 ] {9a869787-8fee-4248-9e14-bca9c993797b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1200703 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:10.611464 [ 22326 ] {97f147b8-a514-4564-83e0-6ec7ec284022} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1068096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48232) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:10.611618 [ 22342 ] {ef7068e0-8d36-44a2-a186-f1e009522c26} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:32926) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:10.611675 [ 22363 ] {63ae3737-75ae-4b7a-bda6-98bc54acf30f} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39160) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:12.648083 [ 22337 ] {c14ec653-7635-4ea6-9ca0-ce848e6802ac} <Error> executeQuery: Code: 407. DB::Exception: Decimal math overflow: While processing makeDateTime64(2262, 4, 11, 23, 47, 16, 854775808, 9, 'UTC'). (DECIMAL_OVERFLOW) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57524) (comment: 02245_make_datetime64.sql) (in query: select makeDateTime64(2262, 4, 11, 23, 47, 16, 854775808, 9, 'UTC');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [22]>(int, char const (&) [22]) @ 0x000000000947da37 in /usr/bin/clickhouse
3. DB::DateTime64 DB::DecimalUtils::decimalFromComponents<DB::DateTime64>(DB::DateTime64::NativeType const&, DB::DateTime64::NativeType const&, unsigned int) @ 0x000000000948fdd7 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000171a7331 in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:44:13.761691 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4217279 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.761773 [ 22323 ] {759b6fa7-c211-437e-8ada-275542e9f54d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57476) (comment: 01064_incremental_streaming_from_2_src_with_feedback.sql) (in query: CREATE TABLE target_table ENGINE = SummingMergeTree ORDER BY id SETTINGS index_granularity = 128, index_granularity_bytes = '10Mi', min_bytes_for_wide_part = 338549596, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 18837, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 1, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 59524, primary_key_compress_block_size = 82495 AS SELECT number AS id, maxState(toDateTime(0, 'UTC')) AS latest_login_time, maxState(toDateTime(0, 'UTC')) AS latest_checkout_time, minState(toUInt64(-1)) AS fastest_session, maxState(toUInt64(0)) AS biggest_inactivity_period FROM numbers(50000) GROUP BY id), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:164: DB::pushBackAndCreateState(DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::Arena&, DB::IAggregateFunction const*) @ 0x000000003ac89f83 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnAggregateFunction.cpp:525: DB::ColumnAggregateFunction::insertDefault() @ 0x000000003ac8852a in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Merges/Algorithms/SummingSortedAlgorithm.cpp:0: DB::SummingSortedAlgorithm::SummingMergedData::startGroup(std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, unsigned long) @ 0x000000003efe66af in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/SummingSortedAlgorithm.cpp:0: DB::SummingSortedAlgorithm::merge() @ 0x000000003effafcc in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:367: DB::MergeTreeDataWriter::mergeBlock(DB::Block const&, DB::SortDescription, std::vector<String, std::allocator<String>> const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>*&, DB::MergeTreeData::MergingParams const&) @ 0x000000003d640bc0 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d644c40 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.761971 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.762180 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 4521724 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.762243 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.762364 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 5156673 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.762468 [ 22325 ] {b64361dc-c610-4e8d-8d23-0625970b090f} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1200703 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.762189 [ 22358 ] {f3591632-ad94-4fb4-8afa-febb4e5b1fc1} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1375324 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 120 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51324) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:13.762815 [ 22335 ] {bdb1d03c-3023-40c2-a6b1-068e36627d46} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 270 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57496) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:13.762597 [ 22334 ] {fe645ab5-20ad-4869-a605-5c90a6dc110b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1091080 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e84f0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.762192 [ 22353 ] {a9662729-8ed2-4b85-a1f8-1fc70ad4f75e} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1375156 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 60 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33250) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:13.762487 [ 2432 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.765151 [ 22347 ] {f7800e6b-9c27-464c-bf08-4be1f7813bee} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1096456 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e84f0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.767429 [ 22332 ] {9320f406-5bc0-43ab-9284-8ccc51fd640a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1091080 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e84f0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.767698 [ 22367 ] {c72a4bf5-56e8-4444-ae84-59f5bcc1053d} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1069998 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingInOrderTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:322: DB::Aggregator::addSingleKeyToAggregateColumns(DB::AggregatedDataVariants&, std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&) const @ 0x0000000037dfb89d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingInOrderTransform.cpp:0: DB::AggregatingInOrderTransform::consume(DB::Chunk) @ 0x000000003f054ae1 in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/AggregatingInOrderTransform.cpp:0: DB::AggregatingInOrderTransform::work() @ 0x000000003f059c1e in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.767723 [ 24259 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.767743 [ 24260 ] {53530bd0-ec0d-4036-953c-5045858e1ae0} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:44:13.767863 [ 22327 ] {bc066051-b20c-4834-aad7-4b3563ed9f57} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1068096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.767939 [ 22322 ] {dac44a4c-3872-4f05-81ea-5e5a7b02c0b4} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1068096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.767926 [ 22341 ] {fc607c76-5de4-479b-a247-a946c9a4446b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1071288 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:13.768122 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_93_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1051207 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.768133 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4195005 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:13.769402 [ 22360 ] {2fbe8798-972d-469a-aaf3-a2169213e3b3} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1068096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:15.079483 [ 22342 ] {ef7068e0-8d36-44a2-a186-f1e009522c26} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:15.079570 [ 22369 ] {60143b9b-e3a2-4728-a2c2-a0e9293ef231} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1096447 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b34a246 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:478: DB::MergeTreeRangeReader::ReadResult::applyFilter(DB::FilterWithCachedCount const&) @ 0x000000003d50c229 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::MergeTreeRangeReader::ReadResult::optimize(DB::FilterWithCachedCount const&, bool) @ 0x000000003d512fd0 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1388: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x000000003d52e672 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1074: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d524de4 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:15.079620 [ 22326 ] {97f147b8-a514-4564-83e0-6ec7ec284022} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1068096 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::ColumnVector<unsigned int>::filter(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, long) const @ 0x000000003b2b0cc6 in /usr/bin/clickhouse
10. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::filterColumns(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, DB::FilterWithCachedCount const&) @ 0x000000003d50dd5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:1015: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5219a5 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:15.079573 [ 22363 ] {63ae3737-75ae-4b7a-bda6-98bc54acf30f} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:15.079767 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_130_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1118431 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.079743 [ 22337 ] {c14ec653-7635-4ea6-9ca0-ce848e6802ac} <Error> TCPHandler: Code: 407. DB::Exception: Decimal math overflow: While processing makeDateTime64(2262, 4, 11, 23, 47, 16, 854775808, 9, 'UTC'). (DECIMAL_OVERFLOW), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [22]>(int, char const (&) [22]) @ 0x000000000947da37 in /usr/bin/clickhouse
3. DB::DateTime64 DB::DecimalUtils::decimalFromComponents<DB::DateTime64>(DB::DateTime64::NativeType const&, DB::DateTime64::NativeType const&, unsigned int) @ 0x000000000948fdd7 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000171a7331 in /usr/bin/clickhouse
5. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:164: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bed00 in /usr/bin/clickhouse
9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff16 in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d9515 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:44:15.079553 [ 2674 ] {} <Error> ExternalDictionariesLoader: Could not check if external dictionary 'ae6b6c49-3da9-4b66-ae38-1f05c60eac77' was modified: Code: 60. DB::Exception: Table dictdb_01041_01040.dict_invalidate does not exist. Maybe you meant invalidate?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000947c83e in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201cb3 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:194: DB::ClickHouseDictionarySource::doInvalidateQuery(String const&) const @ 0x000000002b0b1f5e in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:139: DB::ClickHouseDictionarySource::isModified() const @ 0x000000002b0b03d9 in /usr/bin/clickhouse
17. ./build_docker/./src/Dictionaries/IDictionary.h:0: DB::IDictionary::isModified() const @ 0x000000002b2a067a in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ExternalLoader.cpp:679: DB::ExternalLoader::LoadingDispatcher::reloadOutdated() @ 0x0000000038d0cc6e in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: DB::ExternalLoader::PeriodicUpdater::doPeriodicUpdates() @ 0x0000000038d0bd3d in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::PeriodicUpdater::*)(), DB::ExternalLoader::PeriodicUpdater*>(void (DB::ExternalLoader::PeriodicUpdater::*&&)(), DB::ExternalLoader::PeriodicUpdater*&&)::'lambda'()::operator()() @ 0x0000000038d11ce7 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::PeriodicUpdater::*)(), DB::ExternalLoader::PeriodicUpdater*>(void (DB::ExternalLoader::PeriodicUpdater::*&&)(), DB::ExternalLoader::PeriodicUpdater*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038d11b3f in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.080012 [ 24493 ] {e2dc0910-bb00-4ab7-a5fb-fa9a1b2a31b9} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 7.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 45705): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44144) (comment: 00147_global_in_aggregate_function.sql) (in query: SELECT `UserID` FROM `test`.`hits`), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
17. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse

2024.09.24 02:44:15.080402 [ 22342 ] {ef7068e0-8d36-44a2-a186-f1e009522c26} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:15.080607 [ 22363 ] {63ae3737-75ae-4b7a-bda6-98bc54acf30f} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:15.090939 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.091018 [ 22323 ] {759b6fa7-c211-437e-8ada-275542e9f54d} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:164: DB::pushBackAndCreateState(DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::Arena&, DB::IAggregateFunction const*) @ 0x000000003ac89f83 in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnAggregateFunction.cpp:525: DB::ColumnAggregateFunction::insertDefault() @ 0x000000003ac8852a in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Merges/Algorithms/SummingSortedAlgorithm.cpp:0: DB::SummingSortedAlgorithm::SummingMergedData::startGroup(std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, unsigned long) @ 0x000000003efe66af in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/SummingSortedAlgorithm.cpp:0: DB::SummingSortedAlgorithm::merge() @ 0x000000003effafcc in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:367: DB::MergeTreeDataWriter::mergeBlock(DB::Block const&, DB::SortDescription, std::vector<String, std::allocator<String>> const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>*&, DB::MergeTreeData::MergingParams const&) @ 0x000000003d640bc0 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d644c40 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e1f86ed in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:15.091094 [ 22325 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:50528). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.091176 [ 22348 ] {440edd5d-0e0c-4064-b476-48c54fcc96d3} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:45212) (comment: 00072_compare_date_and_string_index.sql) (in query: SELECT count() FROM test.hits WHERE EventDate = toDate('2014-03-18');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:15.091188 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.091471 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_78_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1373215 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.091705 [ 22358 ] {f3591632-ad94-4fb4-8afa-febb4e5b1fc1} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1375324 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 120 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:15.091801 [ 22335 ] {bdb1d03c-3023-40c2-a6b1-068e36627d46} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 270 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:15.091938 [ 22353 ] {a9662729-8ed2-4b85-a1f8-1fc70ad4f75e} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1375156 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 60 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:15.092006 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1049407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.095976 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.095977 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:15.115551 [ 22358 ] {f3591632-ad94-4fb4-8afa-febb4e5b1fc1} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:16.386083 [ 2530 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp8066d7c4-2a92-43c2-b293-59d2711d4c27' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:17.513789 [ 24493 ] {e2dc0910-bb00-4ab7-a5fb-fa9a1b2a31b9} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 7.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 45705): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
17. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse

2024.09.24 02:44:17.513826 [ 22348 ] {440edd5d-0e0c-4064-b476-48c54fcc96d3} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:17.513813 [ 18862 ] {} <Error> ExternalDictionariesLoader: Could not update external dictionary 'ae6b6c49-3da9-4b66-ae38-1f05c60eac77', leaving the previous version, next update is scheduled at 2024-09-24 02:44:20: Code: 60. DB::Exception: Table dictdb_01041_01040.dict_invalidate does not exist. Maybe you meant invalidate?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000947c83e in /usr/bin/clickhouse
3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037201cb3 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:421: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x0000000037ad37c2 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x0000000037ae6243 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x0000000039e6b3f8 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b24853 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
15. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:171: DB::ClickHouseDictionarySource::createStreamForQuery(String const&) @ 0x000000002b0af62b in /usr/bin/clickhouse
16. ./build_docker/./src/Dictionaries/ClickHouseDictionarySource.cpp:113: DB::ClickHouseDictionarySource::loadAll() @ 0x000000002b0af3b5 in /usr/bin/clickhouse
17. DB::FlatDictionary::loadData() @ 0x000000002b2d750b in /usr/bin/clickhouse
18. DB::FlatDictionary::FlatDictionary(DB::StorageID const&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration, std::shared_ptr<DB::Block>) @ 0x000000002b2d6f41 in /usr/bin/clickhouse
19. std::shared_ptr<DB::FlatDictionary> std::allocate_shared[abi:v15000]<DB::FlatDictionary, std::allocator<DB::FlatDictionary>, DB::StorageID, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&, void>(std::allocator<DB::FlatDictionary> const&, DB::StorageID&&, DB::DictionaryStructure const&, std::shared_ptr<DB::IDictionarySource>&&, DB::FlatDictionary::Configuration const&, std::shared_ptr<DB::Block> const&) @ 0x000000002b356569 in /usr/bin/clickhouse
20. DB::FlatDictionary::clone() const @ 0x000000002b33fd64 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/ExternalLoader.cpp:0: std::shared_ptr<DB::IExternalLoadable const> std::__function::__policy_invoker<std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>::__call_impl<std::__function::__default_alloc_func<DB::ExternalLoader::ExternalLoader(String const&, Poco::Logger*)::$_0, std::shared_ptr<DB::IExternalLoadable const> (String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&)>>(std::__function::__policy_storage const*, String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const> const&) @ 0x0000000038cc12ce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ExternalLoader::LoadingDispatcher::loadSingleObject(String const&, DB::ExternalLoader::ObjectConfig const&, std::shared_ptr<DB::IExternalLoadable const>) @ 0x0000000038cddd65 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/pair.h:520: DB::ExternalLoader::LoadingDispatcher::doLoading(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>) @ 0x0000000038cd4d95 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'()::operator()() @ 0x0000000038ce957a in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::ExternalLoader::LoadingDispatcher::*)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*, String&, unsigned long&, bool&, unsigned long&, bool, std::shared_ptr<DB::ThreadGroup>>(void (DB::ExternalLoader::LoadingDispatcher::*&&)(String const&, unsigned long, bool, unsigned long, bool, std::shared_ptr<DB::ThreadGroup>), DB::ExternalLoader::LoadingDispatcher*&&, String&, unsigned long&, bool&, unsigned long&, bool&&, std::shared_ptr<DB::ThreadGroup>&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000038ce905f in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:17.514088 [ 22353 ] {a9662729-8ed2-4b85-a1f8-1fc70ad4f75e} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:17.514260 [ 2402 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:17.514273 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:17.514354 [ 22366 ] {db86c626-19e7-4708-b645-204076b45f79} <Error> executeQuery: Code: 241. DB::Exception: Received from 127.0.0.7:9000. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1091080 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e84f0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:47504) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT sum(cityHash64(*)) FROM (SELECT CounterID, quantileTiming(0.5)(SendTiming), count() FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) WHERE SendTiming != -1 GROUP BY CounterID);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:44:19.867983 [ 22337 ] {c42a1027-4f4f-4a68-8ae6-3ccaed0b4f65} <Error> executeQuery: Code: 69. DB::Exception: Argument 'precision' for function makeDateTime64 must be in range [0, 9]: While processing makeDateTime64(1991, 8, 24, 21, 4, 0, 1234, 10, 'CET'). (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57524) (comment: 02245_make_datetime64.sql) (in query: select makeDateTime64(1991, 8, 24, 21, 4, 0, 1234, 10, 'CET');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionMakeDateTime64::extractPrecision(DB::ColumnWithTypeAndName const&) const @ 0x00000000171ab330 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000171a9eef in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:44:19.868334 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4366702 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:19.868453 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_79_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1146752 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::createWithOffsets(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::Field const&, unsigned long, unsigned long) const @ 0x000000003b8d0d91 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::convertToFullColumnIfSparse() const @ 0x000000003b1a7079 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::recursiveRemoveSparse(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x000000003b1b50f7 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.cpp:0: DB::convertToFullIfSparse(DB::Chunk&) @ 0x000000003e1ab758 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Merges/Algorithms/IMergingAlgorithm.h:43: DB::IMergingTransformBase::prepareInitializeInputs() @ 0x000000003ee6ac32 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Merges/IMergingTransform.cpp:164: DB::IMergingTransformBase::prepare() @ 0x000000003ee6e436 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/IProcessor.h:193: DB::IProcessor::prepare(std::vector<unsigned long, std::allocator<unsigned long>> const&, std::vector<unsigned long, std::allocator<unsigned long>> const&) @ 0x0000000020f081fd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/ExecutingGraph.cpp:0: DB::ExecutingGraph::updateNode(unsigned long, std::queue<DB::ExecutingGraph::Node*, std::deque<DB::ExecutingGraph::Node*, std::allocator<DB::ExecutingGraph::Node*>>>&, std::queue<DB::ExecutingGraph::Node*, std::deque<DB::ExecutingGraph::Node*, std::allocator<DB::ExecutingGraph::Node*>>>&) @ 0x000000003e20d64d in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:270: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fd195 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:19.868531 [ 22366 ] {db86c626-19e7-4708-b645-204076b45f79} <Error> TCPHandler: Code: 241. DB::Exception: Received from 127.0.0.7:9000. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1091080 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. DB::Arena::addMemoryChunk(unsigned long) @ 0x000000000c7efecf in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Arena.h:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e84f0 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?
: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:44:19.868696 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_130_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1556448 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_123_5/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 9021): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:19.868728 [ 22323 ] {aee6fb33-61b9-434d-b473-e845d0cdd89a} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.499994566 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42376) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:19.868831 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 5234692 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:19.868852 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 4925796 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:19.869238 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1066748 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column event_time): (while reading from part /var/lib/clickhouse/disks/s3/store/d88/d88f6a6d-9cdb-42d7-874b-d9e099182172/202409_1_74_14/ in table system.zookeeper_log (d88f6a6d-9cdb-42d7-874b-d9e099182172) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:19.869933 [ 2359 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:19.870707 [ 2378 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.039848 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4194606 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:0: DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x00000000208b106a in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.cpp:0: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x000000003b1bed08 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::IColumn, DB::ColumnString>::clone() const @ 0x000000003b1dcc02 in /usr/bin/clickhouse
10. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
11. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c44aff in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.040028 [ 22337 ] {c42a1027-4f4f-4a68-8ae6-3ccaed0b4f65} <Error> TCPHandler: Code: 69. DB::Exception: Argument 'precision' for function makeDateTime64 must be in range [0, 9]: While processing makeDateTime64(1991, 8, 24, 21, 4, 0, 1234, 10, 'CET'). (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionMakeDateTime64::extractPrecision(DB::ColumnWithTypeAndName const&) const @ 0x00000000171ab330 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000171a9eef in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:44:22.040159 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.040276 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_94_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1982360 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.040331 [ 22323 ] {aee6fb33-61b9-434d-b473-e845d0cdd89a} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.499994566 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:22.040491 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.040535 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1049407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.040484 [ 24477 ] {f4bfdab2-2060-40d3-9e12-14bd0f8d5070} <Error> executeQuery: Code: 241. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Memory tracker (for query): fault injected. Would use 7.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 45705): While executing MergeTreeThread. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
17. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:45278) (comment: 00147_global_in_aggregate_function.sql) (in query: SELECT sum(UserID GLOBAL IN (SELECT UserID FROM remote('127.0.0.{1,2}', test.hits))) FROM remote('127.0.0.{1,2}', test.hits);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:44:22.040646 [ 2412 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.040778 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4216767 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.040772 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4195133 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.040754 [ 2434 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.041084 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4217502 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::savingThreadFunction() @ 0x000000003a42c002 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c45ea7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.046213 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_130_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.048139 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.065844 [ 22337 ] {a42432e4-ea63-4306-9cef-d3118666a236} <Error> executeQuery: Code: 69. DB::Exception: Argument 'precision' for function makeDateTime64 must be in range [0, 9]: While processing makeDateTime64(1991, 8, 24, 21, 4, 0, 1234, -1, 'CET'). (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57524) (comment: 02245_make_datetime64.sql) (in query: select makeDateTime64(1991, 8, 24, 21, 4, 0, 1234, -1, 'CET');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionMakeDateTime64::extractPrecision(DB::ColumnWithTypeAndName const&) const @ 0x00000000171ab330 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000171a9eef in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:44:22.068000 [ 22337 ] {a42432e4-ea63-4306-9cef-d3118666a236} <Error> TCPHandler: Code: 69. DB::Exception: Argument 'precision' for function makeDateTime64 must be in range [0, 9]: While processing makeDateTime64(1991, 8, 24, 21, 4, 0, 1234, -1, 'CET'). (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionMakeDateTime64::extractPrecision(DB::ColumnWithTypeAndName const&) const @ 0x00000000171ab330 in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000171a9eef in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:44:22.212952 [ 24477 ] {f4bfdab2-2060-40d3-9e12-14bd0f8d5070} <Error> TCPHandler: Code: 241. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Memory tracker (for query): fault injected. Would use 7.00 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 9.31 GiB: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 45705): While executing MergeTreeThread. Stack trace:

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
17. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a7bcd68 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromVector.h:65: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x00000000209b9a38 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x000000003dd7633f in /usr/bin/clickhouse
5. ./build_docker/./src/Client/Connection.cpp:987: DB::Connection::receivePacket() @ 0x000000003dd911b8 in /usr/bin/clickhouse
6. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000003de56b66 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000036abf5bc in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: std::invoke_result<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>::type std::invoke<Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber>(Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>&, boost::context::fiber&&) @ 0x0000000036abed62 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:0: boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run() @ 0x0000000036abe576 in /usr/bin/clickhouse
10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(unsigned int, unsigned int) @ 0x0000000036abc1f2 in /usr/bin/clickhouse

2024.09.24 02:44:22.245035 [ 22341 ] {ef5515ab-5555-4230-9e71-469b594ab04c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1200703 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:46850) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:22.263363 [ 22341 ] {ef5515ab-5555-4230-9e71-469b594ab04c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1200703 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:22.279248 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_79_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1396639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:22.286293 [ 22332 ] {8a3feb31-4353-427a-8dcd-2f5b00316b7a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1200703 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:50510) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:22.294908 [ 22341 ] {ef5515ab-5555-4230-9e71-469b594ab04c} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:22.299267 [ 22342 ] {bd76ec3f-0c58-46be-89e9-b2f49abccfe9} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42468) (comment: 00061_storage_buffer.sql) (in query: CREATE TABLE test.hits_dst AS test.hits;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:44:23.497023 [ 22332 ] {8a3feb31-4353-427a-8dcd-2f5b00316b7a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1200703 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::CompressedWriteBuffer> std::allocate_shared[abi:v15000]<DB::CompressedWriteBuffer, std::allocator<DB::CompressedWriteBuffer>, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, void>(std::allocator<DB::CompressedWriteBuffer> const&, DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&&) @ 0x000000003e0fa187 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::TCPHandler::initBlockOutput(DB::Block const&) @ 0x000000003e0d37c6 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2009: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000003e0cacb4 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x000000003e0c2d9a in /usr/bin/clickhouse
15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a867f in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:23.497111 [ 22342 ] {bd76ec3f-0c58-46be-89e9-b2f49abccfe9} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:296: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000003ce39cec in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool) @ 0x000000003da169dc in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool const&, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, bool const&) @ 0x000000003da14e2b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000003da07800 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: std::shared_ptr<DB::IStorage> std::__function::__policy_invoker<std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>::__call_impl<std::__function::__default_alloc_func<std::shared_ptr<DB::IStorage> (*)(DB::StorageFactory::Arguments const&), std::shared_ptr<DB::IStorage> (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x00000000357388ba in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/StorageFactory.cpp:225: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x000000003bc0943a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x00000000393f55b0 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393dceea in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse

2024.09.24 02:44:23.497136 [ 22325 ] {65ae40fc-dc10-4695-8b33-48ced478c29d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42390) (comment: 00053_replicate_segfault.sql) (in query: SELECT count() > 0 FROM (SELECT ParsedParams.Key1 AS p FROM test.visits WHERE arrayAll(y -> arrayExists(x -> y != x, p), p)) ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:23.497819 [ 22334 ] {dab5ff15-a2cd-4615-8f8a-fb7c6eef1330} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42424) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:44:23.498070 [ 22369 ] {88d36bda-b662-426e-a34b-3088ce4551bf} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1338746 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 210 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48772) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:23.501158 [ 22360 ] {4069b841-58af-4619-9225-fdb56cf75ec5} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1338603 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49108) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:23.501270 [ 22347 ] {feeb823c-75bd-44a1-8489-81f9369e538f} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:47786) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:23.502939 [ 22327 ] {ec828554-1b39-41bc-be90-37206b7d0198} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:38142) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:23.503594 [ 22335 ] {edd8fa92-b807-4c6d-95f0-edb24120e7f1} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1351774 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 264 with max_rows_to_read = 19162): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42466) (comment: 00034_aggregate_key_fixed_string.sql) (in query: SELECT toFixedString(substring(SearchPhrase, 1, 17), 17) AS k1, count() AS c FROM test.hits GROUP BY k1 ORDER BY c DESC, k1 LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:23.507531 [ 22326 ] {c8833fb8-4a16-4e38-8c9a-d2e1c28170be} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42360) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:23.513709 [ 22322 ] {359f812d-b49c-45a8-8c05-8e4638b2ee45} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1053503 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42400) (comment: 01533_multiple_nested.sql) (in query: INSERT INTO nested VALUES ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:251: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed692d in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse

2024.09.24 02:44:25.373561 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:25.373623 [ 22337 ] {1b070dcf-582b-4004-996f-7c0fc22d32a3} <Error> executeQuery: Code: 36. DB::Exception: Cannot load time zone not a timezone: While processing makeDateTime64(1984, 1, 1, 0, 0, 0, 0, 9, 'not a timezone'). (BAD_ARGUMENTS) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57524) (comment: 02245_make_datetime64.sql) (in query: select makeDateTime64(1984, 1, 1, 0, 0, 0, 0, 9, 'not a timezone');), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/DateLUTImpl.cpp:77: DateLUTImpl::DateLUTImpl(String const&) @ 0x00000000208119a7 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DateLUT::getImplementation(String const&) const @ 0x000000002080a4b1 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/DateLUT.h:62: TimezoneMixin::TimezoneMixin(String const&) @ 0x0000000036ae346e in /usr/bin/clickhouse
6. ./build_docker/./src/DataTypes/DataTypeDateTime64.cpp:0: DB::DataTypeDateTime64::DataTypeDateTime64(unsigned int, String const&) @ 0x0000000036ae49f2 in /usr/bin/clickhouse
7. std::shared_ptr<DB::DataTypeDateTime64> std::allocate_shared[abi:v15000]<DB::DataTypeDateTime64, std::allocator<DB::DataTypeDateTime64>, long&, String&, void>(std::allocator<DB::DataTypeDateTime64> const&, long&, String&) @ 0x00000000171ab5d5 in /usr/bin/clickhouse
8. DB::(anonymous namespace)::FunctionMakeDateTime64::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000171aa0ea in /usr/bin/clickhouse
9. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:44:25.373752 [ 2347 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.118533 [ 22363 ] {9d033fa5-f5d5-444f-8bdf-012dd856a1b1} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 0.00 B (attempt to allocate chunk of 0 bytes), maximum: 18.63 GiB: While executing MergingAggregatedTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42514) (comment: 00170_s3_cache.sql) (in query: SELECT count() FROM test.hits_s3;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:3141: DB::Aggregator::mergeBlocks(std::map<int, std::list<DB::Block, std::allocator<DB::Block>>, std::less<int>, std::allocator<std::pair<int const, std::list<DB::Block, std::allocator<DB::Block>>>>>, DB::AggregatedDataVariants&, unsigned long) @ 0x0000000037e2daf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/MergingAggregatedTransform.cpp:0: DB::MergingAggregatedTransform::generate() @ 0x000000003f1573aa in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/IAccumulatingTransform.cpp:93: DB::IAccumulatingTransform::work() @ 0x000000003eb62b48 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
13. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.118724 [ 22325 ] {65ae40fc-dc10-4695-8b33-48ced478c29d} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.118729 [ 22334 ] {dab5ff15-a2cd-4615-8f8a-fb7c6eef1330} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1367887 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff799 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad12a in /usr/bin/clickhouse
12. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::nextImpl() @ 0x00000000368ad64d in /usr/bin/clickhouse
13. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x00000000370183f2 in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse

2024.09.24 02:44:26.118799 [ 22322 ] {359f812d-b49c-45a8-8c05-8e4638b2ee45} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1053503 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:251: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036ed692d in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse

2024.09.24 02:44:26.118953 [ 22347 ] {feeb823c-75bd-44a1-8489-81f9369e538f} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:47786). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.119074 [ 22360 ] {4069b841-58af-4619-9225-fdb56cf75ec5} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:49108). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.119124 [ 22332 ] {8a3feb31-4353-427a-8dcd-2f5b00316b7a} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:26.119074 [ 22326 ] {c8833fb8-4a16-4e38-8c9a-d2e1c28170be} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:42360). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.119418 [ 22369 ] {88d36bda-b662-426e-a34b-3088ce4551bf} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:48772). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.119567 [ 22327 ] {ec828554-1b39-41bc-be90-37206b7d0198} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:38142). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.119606 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 4276919 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.119640 [ 22360 ] {4069b841-58af-4619-9225-fdb56cf75ec5} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1338603 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:26.120034 [ 22369 ] {88d36bda-b662-426e-a34b-3088ce4551bf} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1338746 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 210 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:26.120127 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 4925284 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.120341 [ 22326 ] {c8833fb8-4a16-4e38-8c9a-d2e1c28170be} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:26.120706 [ 22347 ] {feeb823c-75bd-44a1-8489-81f9369e538f} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:26.121833 [ 22337 ] {1b070dcf-582b-4004-996f-7c0fc22d32a3} <Error> TCPHandler: Code: 36. DB::Exception: Cannot load time zone not a timezone: While processing makeDateTime64(1984, 1, 1, 0, 0, 0, 0, 9, 'not a timezone'). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/DateLUTImpl.cpp:77: DateLUTImpl::DateLUTImpl(String const&) @ 0x00000000208119a7 in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DateLUT::getImplementation(String const&) const @ 0x000000002080a4b1 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/DateLUT.h:62: TimezoneMixin::TimezoneMixin(String const&) @ 0x0000000036ae346e in /usr/bin/clickhouse
6. ./build_docker/./src/DataTypes/DataTypeDateTime64.cpp:0: DB::DataTypeDateTime64::DataTypeDateTime64(unsigned int, String const&) @ 0x0000000036ae49f2 in /usr/bin/clickhouse
7. std::shared_ptr<DB::DataTypeDateTime64> std::allocate_shared[abi:v15000]<DB::DataTypeDateTime64, std::allocator<DB::DataTypeDateTime64>, long&, String&, void>(std::allocator<DB::DataTypeDateTime64> const&, long&, String&) @ 0x00000000171ab5d5 in /usr/bin/clickhouse
8. DB::(anonymous namespace)::FunctionMakeDateTime64::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000171aa0ea in /usr/bin/clickhouse
9. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
10. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
11. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse

2024.09.24 02:44:26.122034 [ 22369 ] {88d36bda-b662-426e-a34b-3088ce4551bf} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:26.122047 [ 22335 ] {edd8fa92-b807-4c6d-95f0-edb24120e7f1} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1351774 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 264 with max_rows_to_read = 19162): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:26.122155 [ 22326 ] {c8833fb8-4a16-4e38-8c9a-d2e1c28170be} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:26.122388 [ 22327 ] {ec828554-1b39-41bc-be90-37206b7d0198} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1338435 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:59: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function<std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>> (String const&, unsigned long)>&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::shared_ptr<DB::FilesystemCacheLog>, bool) @ 0x0000000035796d9d in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: std::__unique_if<DB::ReadBufferFromRemoteFSGather>::__unique_single std::make_unique[abi:v15000]<DB::ReadBufferFromRemoteFSGather, DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>, bool>(DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const::$_0&&, std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings&, std::shared_ptr<DB::FilesystemCacheLog>&&, bool&&) @ 0x00000000372b8417 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7431 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
21. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::SerializationSparse::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003700b782 in /usr/bin/clickhouse
23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse

2024.09.24 02:44:26.133211 [ 22360 ] {4069b841-58af-4619-9225-fdb56cf75ec5} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:26.166177 [ 22347 ] {feeb823c-75bd-44a1-8489-81f9369e538f} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:26.166995 [ 22363 ] {9d033fa5-f5d5-444f-8bdf-012dd856a1b1} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 0.00 B (attempt to allocate chunk of 0 bytes), maximum: 18.63 GiB: While executing MergingAggregatedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:3141: DB::Aggregator::mergeBlocks(std::map<int, std::list<DB::Block, std::allocator<DB::Block>>, std::less<int>, std::allocator<std::pair<int const, std::list<DB::Block, std::allocator<DB::Block>>>>>, DB::AggregatedDataVariants&, unsigned long) @ 0x0000000037e2daf2 in /usr/bin/clickhouse
7. ./build_docker/./src/Processors/Transforms/MergingAggregatedTransform.cpp:0: DB::MergingAggregatedTransform::generate() @ 0x000000003f1573aa in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/IAccumulatingTransform.cpp:93: DB::IAccumulatingTransform::work() @ 0x000000003eb62b48 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
13. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.206792 [ 22327 ] {ec828554-1b39-41bc-be90-37206b7d0198} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:26.248015 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.382496 [ 2396 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.440519 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.444801 [ 2358 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.507835 [ 22323 ] {0d350ca4-d18a-49ac-9fc4-79e91f54c4b9} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.774317356 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42366) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.507971 [ 22367 ] {2ae48694-7647-4dc9-9324-f8d8d92bb2e2} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.680438945 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:38154) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.509582 [ 22358 ] {d51e9f42-2782-4f54-9640-3b640d94bb98} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.069834324 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:46860) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.512995 [ 22341 ] {569a0936-38f8-400c-bfbe-a28b413f21fb} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 270 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:42498) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:26.515823 [ 22323 ] {0d350ca4-d18a-49ac-9fc4-79e91f54c4b9} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.774317356 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.516910 [ 22367 ] {2ae48694-7647-4dc9-9324-f8d8d92bb2e2} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.680438945 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.528737 [ 22358 ] {d51e9f42-2782-4f54-9640-3b640d94bb98} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.069834324 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.538464 [ 24259 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.546084 [ 22323 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:42366). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.550002 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.566392 [ 22367 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:38154). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.578517 [ 22358 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:46860). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000002109f459 in /usr/bin/clickhouse
3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000002109dac8 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x000000003e0a6648 in /usr/bin/clickhouse
5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.608422 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_79_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1059413 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_55_60_1/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1563): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.608564 [ 24259 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.631165 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.647692 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 1049407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.701147 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_94_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1982360 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.712083 [ 24494 ] {b3ef240e-e536-46e3-ab79-5653091054d2} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.375991399 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60734) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.712364 [ 22366 ] {81113662-6370-4c07-b454-0972c23526ef} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.675990314 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:50516) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.747240 [ 22353 ] {811c8af6-eb76-403b-8b12-69ac5c81021b} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.531990835 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:47792) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:26.847685 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_130_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1093504 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_123_5/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 9076): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:26.998455 [ 24260 ] {9d149a89-bce9-41bd-9701-e66a672a0e0e} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.751990039 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48788) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:27.052210 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:27.056844 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_94_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1051591 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:27.076846 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4366702 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:27.084307 [ 22348 ] {cfa98dfe-0255-4e55-a190-e0a71f8da8cc} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.827989763 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49118) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:27.093196 [ 22353 ] {811c8af6-eb76-403b-8b12-69ac5c81021b} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.531990835 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:27.094341 [ 22353 ] {811c8af6-eb76-403b-8b12-69ac5c81021b} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:27.103505 [ 22341 ] {569a0936-38f8-400c-bfbe-a28b413f21fb} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 270 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:27.124738 [ 24494 ] {b3ef240e-e536-46e3-ab79-5653091054d2} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.375991399 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:27.125473 [ 24494 ] {b3ef240e-e536-46e3-ab79-5653091054d2} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:28.689286 [ 22366 ] {81113662-6370-4c07-b454-0972c23526ef} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.675990314 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:28.689350 [ 24260 ] {9d149a89-bce9-41bd-9701-e66a672a0e0e} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.751990039 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:28.689501 [ 2357 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.689473 [ 22369 ] {d135df8e-0c8d-4527-809c-e16fcf9720d2} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 45.14 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 1.40 GiB: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 273 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46358) (comment: 00084_external_aggregation.sql) (in query: SELECT URL, uniq(SearchPhrase) AS u FROM test.hits GROUP BY URL ORDER BY u DESC, URL LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
18. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:44:28.689552 [ 2352 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.689552 [ 22348 ] {cfa98dfe-0255-4e55-a190-e0a71f8da8cc} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.827989763 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:28.690300 [ 22366 ] {81113662-6370-4c07-b454-0972c23526ef} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:28.690381 [ 24260 ] {9d149a89-bce9-41bd-9701-e66a672a0e0e} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:28.690921 [ 22348 ] {cfa98dfe-0255-4e55-a190-e0a71f8da8cc} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:28.694103 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_94_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:37: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11cab1 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.694611 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_84_20}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1069135 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.696013 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_130_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.698350 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.698952 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1050750 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:72: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f86a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.718325 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_79_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.759730 [ 22369 ] {d135df8e-0c8d-4527-809c-e16fcf9720d2} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 45.14 MiB (attempt to allocate chunk of 1048639 bytes), maximum: 1.40 GiB: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 273 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:45: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d909 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
10. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
18. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse

2024.09.24 02:44:28.874266 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1049407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:28.948804 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:31.982222 [ 22367 ] {c091f23e-2f27-4898-9870-2a92cec3316b} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.919604967 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:41604) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:31.982280 [ 22337 ] {e21224e6-777f-43e1-8089-c3fb4b063f59} <Error> executeQuery: Code: 43. DB::Exception: Argument 'precision' for function makeDateTime64 must be constant number: While processing makeDateTime64(year, 1, 1, 1, 0, 0, 0, precision, timezone). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:57524) (comment: 02245_make_datetime64.sql) (in query: select makeDateTime64(year, 1, 1, 1, 0, 0, 0, precision, timezone) from ( select 1984 as year, 5 as precision, 'UTC' as timezone union all select 1985 as year, 5 as precision, 'UTC' as timezone );), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionMakeDateTime64::extractPrecision(DB::ColumnWithTypeAndName const&) const @ 0x00000000171ab17f in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000171a9eef in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:44:31.982348 [ 2400 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:31.982417 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:31.982502 [ 22325 ] {ef253801-c52a-4a60-af3a-b36d1820ec8a} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.004213925 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:38560) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:31.982592 [ 24494 ] {870da174-7dfb-4f2a-9549-22ebff9e6976} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.002567764 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44504) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:31.982524 [ 22326 ] {55b0266a-c0db-45f2-b2b0-d33a2ddb9b6f} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.991051988 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:58800) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:31.982506 [ 22327 ] {ebd0492b-99cd-4f78-912c-136526c1151d} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.775049905 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:48102) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:31.983124 [ 22341 ] {b3354d80-1c83-4a30-a2dd-839d2e62f0ba} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1269992 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 270 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46406) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:33.819688 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:289: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c1b1 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.657477 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 4194556 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66cdfe in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.657577 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 4238846 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:167: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000003700474d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.657651 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 4423454 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::savingThreadFunction() @ 0x000000003a42c002 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c45ea7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.657603 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 4925540 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.657871 [ 22337 ] {e21224e6-777f-43e1-8089-c3fb4b063f59} <Error> TCPHandler: Code: 43. DB::Exception: Argument 'precision' for function makeDateTime64 must be constant number: While processing makeDateTime64(year, 1, 1, 1, 0, 0, 0, precision, timezone). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::(anonymous namespace)::FunctionMakeDateTime64::extractPrecision(DB::ColumnWithTypeAndName const&) const @ 0x00000000171ab17f in /usr/bin/clickhouse
4. DB::(anonymous namespace)::FunctionMakeDateTime64::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000171a9eef in /usr/bin/clickhouse
5. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:198: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d67f5 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d6777c in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47cc1 in /usr/bin/clickhouse
16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x0000000037cd635a in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce9b10 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse

2024.09.24 02:44:35.657955 [ 24494 ] {870da174-7dfb-4f2a-9549-22ebff9e6976} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.002567764 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.658150 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {600ff0c8-1b35-4b24-8e1e-af77c572915c::202409_1_94_18}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1051591 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.658211 [ 22327 ] {ebd0492b-99cd-4f78-912c-136526c1151d} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.775049905 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.658171 [ 22325 ] {ef253801-c52a-4a60-af3a-b36d1820ec8a} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.004213925 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.658252 [ 22326 ] {55b0266a-c0db-45f2-b2b0-d33a2ddb9b6f} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.991051988 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.658401 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_84_20}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.77 GiB (attempt to allocate chunk of 1099873 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/202409_1_83_19/ in table system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 8760): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.658765 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1498358 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_1_1_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6682): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.658979 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_130_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1195330 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_123_5/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8693): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.659039 [ 24494 ] {870da174-7dfb-4f2a-9549-22ebff9e6976} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:35.659070 [ 22363 ] {c7dcf019-5a40-46c7-a129-17d1b16b3643} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.087992446 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:41530) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.659199 [ 22326 ] {55b0266a-c0db-45f2-b2b0-d33a2ddb9b6f} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:35.658288 [ 22367 ] {c091f23e-2f27-4898-9870-2a92cec3316b} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.919604967 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x0000000039fa2ff8 in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fafb2 in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fea4cb39ac3 in ?
10. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.659438 [ 22325 ] {ef253801-c52a-4a60-af3a-b36d1820ec8a} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:35.659216 [ 22358 ] {79d96755-3826-412d-ab6f-7404bd90559c} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.987992807 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:57090) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.659764 [ 22367 ] {c091f23e-2f27-4898-9870-2a92cec3316b} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:35.660853 [ 22323 ] {c09e7816-cf8c-4f12-9da7-5e5cd6fb5c36} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.671993951 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:34118) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.670901 [ 22341 ] {b3354d80-1c83-4a30-a2dd-839d2e62f0ba} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1269992 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 270 with max_rows_to_read = 37223): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:35.670927 [ 22322 ] {f575f931-2c9f-4b36-93ec-04042fa9ccd5} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.027992663 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40854) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:35.670954 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.671051 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_79_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1396639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.670990 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:35.671079 [ 2377 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:37.087637 [ 22332 ] {f90fdebe-2245-4501-9960-ae6d1981e8d8} <Error> executeQuery: Code: 80. DB::Exception: Cannot MATERIALIZE TTL as there is no TTL set for table test_15.ttl (18297191-bddd-418d-9e39-2c79936205a6). (INCORRECT_QUERY) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46436) (comment: 01070_materialize_ttl.sql) (in query: alter table ttl materialize ttl;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:141: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fe208 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:37.087839 [ 22358 ] {79d96755-3826-412d-ab6f-7404bd90559c} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.987992807 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:37.087840 [ 22363 ] {c7dcf019-5a40-46c7-a129-17d1b16b3643} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:41530). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a2102 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000003e0ed81e in /usr/bin/clickhouse
5. ./build_docker/./src/Core/Block.h:25: DB::TCPHandler::sendLogs() @ 0x000000003e0c6bab in /usr/bin/clickhouse
6. ./build_docker/./src/Server/TCPHandler.cpp:680: DB::TCPHandler::runImpl() @ 0x000000003e0a8d8f in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:37.087972 [ 22323 ] {c09e7816-cf8c-4f12-9da7-5e5cd6fb5c36} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.671993951 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:37.088045 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4276919 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:138: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc44ad2 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003cc4366e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d669727 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:37.088084 [ 22322 ] {f575f931-2c9f-4b36-93ec-04042fa9ccd5} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.027992663 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:37.088141 [ 22327 ] {ebd0492b-99cd-4f78-912c-136526c1151d} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:37.088222 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:37.088348 [ 2450 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:37.088487 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:37.088532 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1049407 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:37.753968 [ 22363 ] {c7dcf019-5a40-46c7-a129-17d1b16b3643} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.087992446 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000036a766cc in /usr/bin/clickhouse
3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000036a7592c in /usr/bin/clickhouse
4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000036a729bc in /usr/bin/clickhouse
5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2292cb in /usr/bin/clickhouse
6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
13. ? @ 0x00007fea4cb39ac3 in ?
14. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:37.754066 [ 22324 ] {1b3fc5d6-f66b-459d-92b6-f97d3fcefb9c} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 31.15 MiB (attempt to allocate chunk of 2097152 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46430) (comment: 00174_distinct_in_order.sql) (in query: insert into ordinary_distinct select distinct CounterID, EventDate from test.hits order by CounterID, EventDate settings optimize_distinct_in_order=0;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. DB::PODArray<wide::integer<128ul, unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize_fill(unsigned long) @ 0x000000001cc8db82 in /usr/bin/clickhouse
8. void DB::packFixedBatch<wide::integer<128ul, unsigned int>>(unsigned long, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, std::vector<unsigned long, std::allocator<unsigned long>> const&, DB::PODArray<wide::integer<128ul, unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000001f68b7e2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ColumnsHashing.h:622: DB::ColumnsHashing::HashMethodKeysFixed<wide::integer<128ul, unsigned int>, wide::integer<128ul, unsigned int>, void, false, false, true, false>::HashMethodKeysFixed(std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, std::vector<unsigned long, std::allocator<unsigned long>> const&, std::shared_ptr<DB::ColumnsHashing::HashMethodContext> const&) @ 0x000000003a254cb0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/DistinctTransform.cpp:0: void DB::DistinctTransform::buildFilter<DB::SetMethodKeysFixed<HashSetTable<wide::integer<128ul, unsigned int>, HashTableCell<wide::integer<128ul, unsigned int>, UInt128HashCRC32, HashTableNoState>, UInt128HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, false>>(DB::SetMethodKeysFixed<HashSetTable<wide::integer<128ul, unsigned int>, HashTableCell<wide::integer<128ul, unsigned int>, UInt128HashCRC32, HashTableNoState>, UInt128HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, false>&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, unsigned long, DB::SetVariantsTemplate<DB::NonClearableSet>&) const @ 0x000000003eb90c4d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/DistinctTransform.cpp:92: DB::DistinctTransform::transform(DB::Chunk&) @ 0x000000003eb894a7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
18. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:37.754404 [ 22358 ] {79d96755-3826-412d-ab6f-7404bd90559c} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:37.754600 [ 22322 ] {f575f931-2c9f-4b36-93ec-04042fa9ccd5} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:37.754854 [ 22332 ] {f90fdebe-2245-4501-9960-ae6d1981e8d8} <Error> TCPHandler: Code: 80. DB::Exception: Cannot MATERIALIZE TTL as there is no TTL set for table test_15.ttl (18297191-bddd-418d-9e39-2c79936205a6). (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:141: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395fe208 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
14. ? @ 0x00007fea4cb39ac3 in ?
15. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:37.755230 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_130_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1118431 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:37.755502 [ 22323 ] {c09e7816-cf8c-4f12-9da7-5e5cd6fb5c36} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:38.415702 [ 22333 ] {273ae3a6-18f1-4494-9a83-ea7b7eb17223} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1310942 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/gfi/lyttdhozpzolhhvjzajygzbktzllu, hash key: 44faf8c47e5d7b1391b81dd019c8e213, file_offset_of_buffer_end: 614138, read_until_position: 672513, internal buffer end: 764813, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 273ae3a6-18f1-4494-9a83-ea7b7eb17223:17600, file segment info: File segment: [0, 764812], key: 44faf8c47e5d7b1391b81dd019c8e213, state: DOWNLOADING, downloaded size: 0, reserved size: 614138, downloader id: 273ae3a6-18f1-4494-9a83-ea7b7eb17223:17600, current write offset: 0, caller id: 273ae3a6-18f1-4494-9a83-ea7b7eb17223:17600, kind: Regular, unbound: 0: (while reading column URLRegions): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 285 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59784) (comment: 00061_storage_buffer.sql) (in query: INSERT INTO test.hits_buffer SELECT * FROM test.hits WHERE CounterID = 800784;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000003579aea6 in /usr/bin/clickhouse
20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a6245 in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CachedCompressedReadBuffer.cpp:0: DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003d4952d7 in /usr/bin/clickhouse
22. ./build_docker/./src/Compression/CachedCompressedReadBuffer.cpp:0: non-virtual thunk to DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003d496b0d in /usr/bin/clickhouse
23. DB::ReadBuffer::readBig(char*, unsigned long) @ 0x000000000a78701d in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
25. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
26. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse

2024.09.24 02:44:38.415975 [ 22324 ] {1b3fc5d6-f66b-459d-92b6-f97d3fcefb9c} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 31.15 MiB (attempt to allocate chunk of 2097152 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. DB::PODArray<wide::integer<128ul, unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize_fill(unsigned long) @ 0x000000001cc8db82 in /usr/bin/clickhouse
8. void DB::packFixedBatch<wide::integer<128ul, unsigned int>>(unsigned long, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, std::vector<unsigned long, std::allocator<unsigned long>> const&, DB::PODArray<wide::integer<128ul, unsigned int>, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000001f68b7e2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/ColumnsHashing.h:622: DB::ColumnsHashing::HashMethodKeysFixed<wide::integer<128ul, unsigned int>, wide::integer<128ul, unsigned int>, void, false, false, true, false>::HashMethodKeysFixed(std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, std::vector<unsigned long, std::allocator<unsigned long>> const&, std::shared_ptr<DB::ColumnsHashing::HashMethodContext> const&) @ 0x000000003a254cb0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/DistinctTransform.cpp:0: void DB::DistinctTransform::buildFilter<DB::SetMethodKeysFixed<HashSetTable<wide::integer<128ul, unsigned int>, HashTableCell<wide::integer<128ul, unsigned int>, UInt128HashCRC32, HashTableNoState>, UInt128HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, false>>(DB::SetMethodKeysFixed<HashSetTable<wide::integer<128ul, unsigned int>, HashTableCell<wide::integer<128ul, unsigned int>, UInt128HashCRC32, HashTableNoState>, UInt128HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, false>&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, unsigned long, DB::SetVariantsTemplate<DB::NonClearableSet>&) const @ 0x000000003eb90c4d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/DistinctTransform.cpp:92: DB::DistinctTransform::transform(DB::Chunk&) @ 0x000000003eb894a7 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
18. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
22. ? @ 0x00007fea4cb39ac3 in ?
23. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:38.416048 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:38.416091 [ 22363 ] {c7dcf019-5a40-46c7-a129-17d1b16b3643} <Warning> TCPHandler: Client has gone away.
2024.09.24 02:44:38.416203 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1123860 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_4_4_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6214): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:38.416206 [ 2397 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:38.429395 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6a81680-70ad-40b6-ab6b-ce1010829d70::202409_1_89_21}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1077016 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/d6a/d6a81680-70ad-40b6-ab6b-ce1010829d70/202409_1_84_20/ in table system.opentelemetry_span_log (d6a81680-70ad-40b6-ab6b-ce1010829d70) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 8692): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:38.521315 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13fd78 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:38.649853 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_79_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1153408 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_55_60_1/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1563): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned long>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9e647 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::SerializationNamed::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036f6f42c in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/SerializationTuple.cpp:0: DB::SerializationTuple::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x000000003703366c in /usr/bin/clickhouse
14. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
15. ./build_docker/./src/DataTypes/Serializations/SerializationMap.cpp:363: DB::SerializationMap::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036f6dcad in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:38.984705 [ 22333 ] {273ae3a6-18f1-4494-9a83-ea7b7eb17223} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1310942 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/gfi/lyttdhozpzolhhvjzajygzbktzllu, hash key: 44faf8c47e5d7b1391b81dd019c8e213, file_offset_of_buffer_end: 614138, read_until_position: 672513, internal buffer end: 764813, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 273ae3a6-18f1-4494-9a83-ea7b7eb17223:17600, file segment info: File segment: [0, 764812], key: 44faf8c47e5d7b1391b81dd019c8e213, state: DOWNLOADING, downloaded size: 0, reserved size: 614138, downloader id: 273ae3a6-18f1-4494-9a83-ea7b7eb17223:17600, current write offset: 0, caller id: 273ae3a6-18f1-4494-9a83-ea7b7eb17223:17600, kind: Regular, unbound: 0: (while reading column URLRegions): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 285 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000003579aea6 in /usr/bin/clickhouse
20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a6245 in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CachedCompressedReadBuffer.cpp:0: DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003d4952d7 in /usr/bin/clickhouse
22. ./build_docker/./src/Compression/CachedCompressedReadBuffer.cpp:0: non-virtual thunk to DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003d496b0d in /usr/bin/clickhouse
23. DB::ReadBuffer::readBig(char*, unsigned long) @ 0x000000000a78701d in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
25. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
26. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036ede0c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse

2024.09.24 02:44:39.415063 [ 22324 ] {d3a39228-4ba5-4c94-af0b-f52049887b5d} <Error> executeQuery: Code: 70. DB::Exception: Conversion from AggregateFunction(argMax, String, UInt64) to AggregateFunction(argMax, Enum8('<Empty>' = -1, 'Male' = 1, 'Female' = 2), UInt64) is not supported: While processing _CAST(arrayReduce('argMaxState', ['cast(-1, \'Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2)'], [toUInt64(0)]) AS t_tmp_alter5349958904390373877, 'AggregateFunction(argMax, Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2), UInt64)') AS t: default expression and column type are incompatible. (CANNOT_CONVERT_TYPE) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59856) (comment: 01258_wrong_cast_filimonov.sql) (in query: CREATE TABLE x (`id` UInt64, `t` AggregateFunction(argMax, Enum8('<Empty>' = -1, 'Male' = 1, 'Female' = 2), UInt64) DEFAULT arrayReduce('argMaxState', ['cast(-1, \'Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2)'], [toUInt64(0)])) ENGINE = MergeTree ORDER BY id SETTINGS index_granularity = 29889, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 22874, prefer_fetch_merged_part_size_threshold = 5088748759, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 5065265087, index_granularity_bytes = 15497548, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 86898, primary_key_compress_block_size = 28164), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionCast<DB::CastInternalName>::createAggregateFunctionWrapper(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeAggregateFunction const*) const @ 0x000000000942d569 in /usr/bin/clickhouse
4. DB::FunctionCast<DB::CastInternalName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x000000000941cfce in /usr/bin/clickhouse
5. DB::FunctionCast<DB::CastInternalName>::prepareRemoveNullable(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x0000000009415b42 in /usr/bin/clickhouse
6. DB::FunctionCast<DB::CastInternalName>::prepareUnpackDictionaries(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&) const @ 0x000000000940ef00 in /usr/bin/clickhouse
7. DB::FunctionCast<DB::CastInternalName>::prepare(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000940d4df in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d8ece in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ExpressionAnalyzer::getActionsDAG(bool, bool) @ 0x0000000037cdeff8 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1729: DB::ExpressionAnalyzer::getActions(bool, bool, DB::CompileExpressions) @ 0x0000000037cdff13 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/ColumnsDescription.cpp:847: DB::validateColumnsDefaultsAndGetSampleBlock(std::shared_ptr<DB::IAST>, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>) @ 0x000000003b970f51 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr<DB::Context const>, bool) @ 0x00000000393ad872 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b4074 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse

2024.09.24 02:44:39.434887 [ 2389 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:39.438809 [ 2369 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:39.456757 [ 22324 ] {d3a39228-4ba5-4c94-af0b-f52049887b5d} <Error> TCPHandler: Code: 70. DB::Exception: Conversion from AggregateFunction(argMax, String, UInt64) to AggregateFunction(argMax, Enum8('<Empty>' = -1, 'Male' = 1, 'Female' = 2), UInt64) is not supported: While processing _CAST(arrayReduce('argMaxState', ['cast(-1, \'Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2)'], [toUInt64(0)]) AS t_tmp_alter5349958904390373877, 'AggregateFunction(argMax, Enum8(\'<Empty>\' = -1, \'Male\' = 1, \'Female\' = 2), UInt64)') AS t: default expression and column type are incompatible. (CANNOT_CONVERT_TYPE), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000093c9ad5 in /usr/bin/clickhouse
3. DB::FunctionCast<DB::CastInternalName>::createAggregateFunctionWrapper(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeAggregateFunction const*) const @ 0x000000000942d569 in /usr/bin/clickhouse
4. DB::FunctionCast<DB::CastInternalName>::prepareImpl(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x000000000941cfce in /usr/bin/clickhouse
5. DB::FunctionCast<DB::CastInternalName>::prepareRemoveNullable(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&, bool) const @ 0x0000000009415b42 in /usr/bin/clickhouse
6. DB::FunctionCast<DB::CastInternalName>::prepareUnpackDictionaries(std::shared_ptr<DB::IDataType const> const&, std::shared_ptr<DB::IDataType const> const&) const @ 0x000000000940ef00 in /usr/bin/clickhouse
7. DB::FunctionCast<DB::CastInternalName>::prepare(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000940d4df in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunctionImpl(std::shared_ptr<DB::IFunctionBase const> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>>, String, std::shared_ptr<DB::IDataType const>, bool) @ 0x00000000374d8ece in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>>, String) @ 0x00000000374d6ab4 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d4650c in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::Data::addFunction(std::shared_ptr<DB::IFunctionOverloadResolver> const&, std::vector<String, std::allocator<String>> const&, String) @ 0x0000000037d769b3 in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d4df07 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(std::shared_ptr<DB::IAST> const&, DB::ActionsMatcher::Data&) @ 0x0000000037d47b55 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor<DB::ActionsMatcher, true, false, std::shared_ptr<DB::IAST> const>::doVisit(std::shared_ptr<DB::IAST> const&) @ 0x0000000037d26875 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr<DB::IAST> const&, bool, std::shared_ptr<DB::ActionsDAG>&, bool) @ 0x0000000037cacdce in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ExpressionAnalyzer::getActionsDAG(bool, bool) @ 0x0000000037cdeff8 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1729: DB::ExpressionAnalyzer::getActions(bool, bool, DB::CompileExpressions) @ 0x0000000037cdff13 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/ColumnsDescription.cpp:847: DB::validateColumnsDefaultsAndGetSampleBlock(std::shared_ptr<DB::IAST>, DB::NamesAndTypesList const&, std::shared_ptr<DB::Context const>) @ 0x000000003b970f51 in /usr/bin/clickhouse
19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr<DB::Context const>, bool) @ 0x00000000393ad872 in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b4074 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
26. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
27. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse

2024.09.24 02:44:45.953089 [ 22342 ] {4bf17410-a06e-43c9-acef-6a51184cc5ee} <Error> executeQuery: Code: 48. DB::Exception: Cannot support collation, please set compatibility_ignore_collation_in_create_table=true. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59878) (comment: 02269_create_table_with_collation.sql) (in query: CREATE TABLE t_02267_collation (x varchar(255) COLLATE utf8_unicode_ci NOT NULL) ENGINE = Memory;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [89]>(int, char const (&) [89]) @ 0x0000000035c57ef7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:497: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr<DB::Context const>, bool) @ 0x00000000393b1066 in /usr/bin/clickhouse
4. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b4074 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:45.953137 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.953138 [ 2404 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.953286 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 5162112 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.953353 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 5234550 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f47322 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.953375 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4992029 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.953905 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 5162433 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.953992 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 4256413 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.954070 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1118460 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.954145 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 4216509 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.954092 [ 22324 ] {7c8c2c7c-0012-4393-b067-478cfdbf2ff8} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1250436 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 54 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59888) (comment: 00037_uniq_state_merge1.sql) (in query: SELECT k, any(u) AS u, uniqMerge(us) AS us FROM (SELECT domain(URL) AS k, uniq(UserID) AS u, uniqState(UserID) AS us FROM test.hits GROUP BY k) GROUP BY k ORDER BY u DESC, k ASC LIMIT 100 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:45.954307 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/SerializationNullable.cpp:59: DB::SerializationNullable::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f72df1 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:45.954389 [ 22358 ] {24509bd3-6de1-412b-9bb1-ea0750e5c68c} <Error> executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39240) (comment: 00074_full_join.sql) (in query: SELECT CounterID, hits, visits FROM ( SELECT (CounterID % 100000) AS CounterID, count() AS hits FROM test.hits GROUP BY CounterID ) ANY FULL OUTER JOIN ( SELECT (CounterID % 100000) AS CounterID, sum(Sign) AS visits FROM test.visits GROUP BY CounterID HAVING visits > 0 ) USING CounterID WHERE hits = 0 OR visits = 0 ORDER BY hits + visits * 10 DESC, CounterID ASC LIMIT 20;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:47.641473 [ 22342 ] {4bf17410-a06e-43c9-acef-6a51184cc5ee} <Error> TCPHandler: Code: 48. DB::Exception: Cannot support collation, please set compatibility_ignore_collation_in_create_table=true. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./src/Common/Exception.h:0: DB::Exception::Exception<char const (&) [89]>(int, char const (&) [89]) @ 0x0000000035c57ef7 in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:497: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr<DB::Context const>, bool) @ 0x00000000393b1066 in /usr/bin/clickhouse
4. ./build_docker/./contrib/boost/boost/multi_index_container.hpp:1000: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x00000000393b4074 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1203: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000393d3f82 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1731: DB::InterpreterCreateQuery::execute() @ 0x000000003940733c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
16. ? @ 0x00007fea4cb39ac3 in ?
17. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:47.641490 [ 22358 ] {24509bd3-6de1-412b-9bb1-ea0750e5c68c} <Error> TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:47.641496 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 4248482 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:47.641787 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:47.641908 [ 22324 ] {7c8c2c7c-0012-4393-b067-478cfdbf2ff8} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1250436 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 54 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:47.641962 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_72_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1411198 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:47.642082 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 2449471 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:47.642211 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_80_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1049812 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_71_71_0/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 130): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:47.642464 [ 2432 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:47.643585 [ 2331 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:48.535088 [ 2538 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmpab6a9c16-7975-4905-8c85-849f1345aa17' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:49.722788 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 5157057 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:49.722859 [ 2441 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:49.722901 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:49.722955 [ 22363 ] {89d9ba59-4618-46e4-9ea2-21534d7dd7b8} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1825991 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/oxp/qzfxfqojsmujpkbuwwqjoajrkwwpi, hash key: 9c3ad43b7449e4701def44cc1bd85b25, file_offset_of_buffer_end: 0, read_until_position: 695210, internal buffer end: 695210, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 89d9ba59-4618-46e4-9ea2-21534d7dd7b8:19412, file segment info: File segment: [0, 695209], key: 9c3ad43b7449e4701def44cc1bd85b25, state: DOWNLOADING, downloaded size: 0, reserved size: 695210, downloader id: 89d9ba59-4618-46e4-9ea2-21534d7dd7b8:19412, current write offset: 0, caller id: 89d9ba59-4618-46e4-9ea2-21534d7dd7b8:19412, kind: Regular, unbound: 0: (while reading column Income): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:59860) (comment: 00154_avro.sql) (in query: INSERT INTO test.avro SELECT * FROM test.hits LIMIT 10000;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000003579aea6 in /usr/bin/clickhouse
19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a96c6 in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<char8_t>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f96ea2 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:44:49.727947 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:49.752526 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_80_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1420063 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:49.967056 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1222547 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (avg_value_size_hint = 29.366455078125, avg_chars_size = 25.63974609375, limit = 8192): (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/d88/d88f6a6d-9cdb-42d7-874b-d9e099182172/202409_1_74_14/ in table system.zookeeper_log (d88f6a6d-9cdb-42d7-874b-d9e099182172) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:50.024006 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:50.236896 [ 22363 ] {89d9ba59-4618-46e4-9ea2-21534d7dd7b8} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1825991 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/oxp/qzfxfqojsmujpkbuwwqjoajrkwwpi, hash key: 9c3ad43b7449e4701def44cc1bd85b25, file_offset_of_buffer_end: 0, read_until_position: 695210, internal buffer end: 695210, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 89d9ba59-4618-46e4-9ea2-21534d7dd7b8:19412, file segment info: File segment: [0, 695209], key: 9c3ad43b7449e4701def44cc1bd85b25, state: DOWNLOADING, downloaded size: 0, reserved size: 695210, downloader id: 89d9ba59-4618-46e4-9ea2-21534d7dd7b8:19412, current write offset: 0, caller id: 89d9ba59-4618-46e4-9ea2-21534d7dd7b8:19412, kind: Regular, unbound: 0: (while reading column Income): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000003579aea6 in /usr/bin/clickhouse
19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x00000000368a96c6 in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae46b in /usr/bin/clickhouse
21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<char8_t>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f96ea2 in /usr/bin/clickhouse
23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse

2024.09.24 02:44:50.723689 [ 2425 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:50.723911 [ 2367 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:50.933780 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:51.241733 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_80_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1420063 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:51.364206 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:51.367224 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4194391 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x00000000208bc5ec in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<unsigned long>>::clone() const @ 0x000000003b422c66 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::savingThreadFunction() @ 0x000000003a3f41e2 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c42907 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c427df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:51.429852 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_73_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:51.663378 [ 2542 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp2192ef54-a3af-4f7a-bc3d-334c0915964b' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:51.724365 [ 2345 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:51.725032 [ 2404 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:51.769502 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:52.048893 [ 2534 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:52.538392 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp6df48b2a-7b92-496f-96a1-603f375ecce0' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:52.543264 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:52.573975 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:52.725224 [ 2338 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:52.726026 [ 2337 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:52.956979 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_80_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1420063 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.017220 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5234550 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f47322 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.413059 [ 2533 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp15adf3df-4bbe-40c5-b977-358ce5b15797' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:53.422465 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.603771 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4861089 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.603857 [ 2639 ] {} <Error> void DB::SystemLog<DB::QueryViewsLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryViewsLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 5160513 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.699426 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.716988 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 5241665 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.725997 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.727037 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:53.983660 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:54.115354 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_80_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1420063 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:54.118960 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:54.247898 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp1dfab0f5-80de-489e-aa49-3895ce9536cc' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:54.253118 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:54.585633 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_68_73_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:54.727044 [ 2436 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:54.727770 [ 2440 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:54.875735 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:54.888494 [ 2530 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmpd4eb4eef-7fcc-41ba-97df-b59c0c76dc0a' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:54.894389 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:55.357912 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:55.383721 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:55.451393 [ 2526 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp1b056010-c440-485e-bf71-56c59a9ae8b7' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:55.455731 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:55.538309 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4562652 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:0: DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x00000000208b106a in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.cpp:0: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x000000003b1bed08 in /usr/bin/clickhouse
9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::IColumn, DB::ColumnString>::clone() const @ 0x000000003b1dcc02 in /usr/bin/clickhouse
10. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
11. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
27. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4eadf in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:55.727744 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:55.728522 [ 2365 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:55.920216 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 5217505 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:56.048781 [ 2532 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp8a36feaf-032a-47b1-a81d-54eaadbf2853' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:44:56.739000 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_80_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1420063 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:56.739010 [ 22334 ] {2699f7ad-61ec-4245-933b-46b3a939f30f} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1392896 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing CollapsingSortedTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46372) (comment: 00013_sorting_of_nested.sql) (in query: SELECT ParsedParams.Key1 FROM test.visits FINAL WHERE VisitID != 0 AND notEmpty(ParsedParams.Key1) ORDER BY VisitID LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<unsigned long>::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b2bc645 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::CollapsingSortedAlgorithm::insertRows() @ 0x000000003ee9ec4a in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Merges/Algorithms/CollapsingSortedAlgorithm.cpp:0: DB::CollapsingSortedAlgorithm::merge() @ 0x000000003eea0d1c in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::CollapsingSortedAlgorithm>::work() @ 0x000000003ce04d22 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:58.072396 [ 22332 ] {999f8030-a3a8-40a3-9acd-8f545213272a} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46436) (comment: 01070_materialize_ttl.sql) (in query: alter table ttl materialize ttl settings mutations_sync=2;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationEntry.cpp:0: DB::MergeTreeMutationEntry::MergeTreeMutationEntry(DB::MutationCommands, std::shared_ptr<DB::IDisk>, String const&, unsigned long, DB::TransactionID const&, DB::WriteSettings const&) @ 0x000000003daa45be in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteSettings.h:10: DB::StorageMergeTree::startMutation(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000003da251d1 in /usr/bin/clickhouse
19. ./build_docker/./src/Core/SettingsFields.h:47: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000003da2e964 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f9be2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:59.083860 [ 22353 ] {b03ae314-d0cc-4364-afdd-30f4defec91d} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1659242 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_123_5/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 37823): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46466) (comment: 00177_memory_bound_merging.sh) (in query: SELECT COUNT() > 0 FROM system.text_log WHERE query_id IN (SELECT query_id FROM system.query_log WHERE query_id != 'query_id_memory_bound_merging_119873980' AND initial_query_id = 'query_id_memory_bound_merging_119873980' AND event_date >= yesterday()) AND event_date >= yesterday() AND logger_name = 'MergeTreeInOrderSelectProcessor'), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:44:59.084161 [ 2375 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:59.084201 [ 22334 ] {2699f7ad-61ec-4245-933b-46b3a939f30f} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1392896 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing CollapsingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x0000000009435ced in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<unsigned long>::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b2bc645 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::CollapsingSortedAlgorithm::insertRows() @ 0x000000003ee9ec4a in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Merges/Algorithms/CollapsingSortedAlgorithm.cpp:0: DB::CollapsingSortedAlgorithm::merge() @ 0x000000003eea0d1c in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::CollapsingSortedAlgorithm>::work() @ 0x000000003ce04d22 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000003e1fb5fe in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000003e1fb06d in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003e234e26 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
21. ? @ 0x00007fea4cb39ac3 in ?
22. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:59.084194 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:59.084318 [ 22323 ] {163da02d-954a-4c8c-9307-0540708b9fa4} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1067248 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39292) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:59.084136 [ 22324 ] {717dd128-42cb-44c8-86b0-4efb33cda65b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1902760 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 137.43310546875, avg_chars_size = 155.3197265625, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39270) (comment: 00093_prewhere_array_join.sql) (in query: SELECT arrayJoin([SearchEngineID]) AS search_engine, URL FROM test.hits WHERE SearchEngineID != 0 AND search_engine != 0 FORMAT Null;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:59.084330 [ 22332 ] {999f8030-a3a8-40a3-9acd-8f545213272a} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationEntry.cpp:0: DB::MergeTreeMutationEntry::MergeTreeMutationEntry(DB::MutationCommands, std::shared_ptr<DB::IDisk>, String const&, unsigned long, DB::TransactionID const&, DB::WriteSettings const&) @ 0x000000003daa45be in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteSettings.h:10: DB::StorageMergeTree::startMutation(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000003da251d1 in /usr/bin/clickhouse
19. ./build_docker/./src/Core/SettingsFields.h:47: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000003da2e964 in /usr/bin/clickhouse
20. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000395f9be2 in /usr/bin/clickhouse
21. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x00000000395f1f04 in /usr/bin/clickhouse
22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
30. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
31. ? @ 0x00007fea4cb39ac3 in ?

2024.09.24 02:44:59.084510 [ 22342 ] {1751a29a-6e35-491e-9ae8-82f38c7a047f} <Error> executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39276) (comment: 00927_asof_joins.sql) (in query: SELECT tv.key, toString(tv.t, 'UTC'), md.bid, tv.tv, md.ask FROM tv ASOF LEFT JOIN md USING(key,t) ORDER BY (tv.key, tv.t);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:59.088891 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:59.089039 [ 22342 ] {1751a29a-6e35-491e-9ae8-82f38c7a047f} <Error> TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>(int, FormatStringHelperImpl<std::type_identity<fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>>::type>, fmt::v8::join_view<std::__wrap_iter<String*>, std::__wrap_iter<String*>, char>&&) @ 0x0000000037d0e94d in /usr/bin/clickhouse
3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cc5804 in /usr/bin/clickhouse
4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr<DB::ActionsDAG>&) @ 0x0000000037cbb52c in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, bool, bool, bool, std::shared_ptr<DB::FilterDAGInfo> const&, std::shared_ptr<DB::FilterDAGInfo> const&, DB::Block const&) @ 0x0000000037ce52af in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x0000000039b5bacb in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>)::$_0::operator()(bool) const @ 0x0000000039b40dc1 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, std::optional<DB::Pipe>, std::shared_ptr<DB::IStorage> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::PreparedSets>) @ 0x0000000039b2caf2 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039b200e7 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr<DB::IAST> const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d87c99 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:152: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x0000000039d827ce in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: std::__unique_if<DB::InterpreterSelectWithUnionQuery>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectWithUnionQuery, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>&, DB::SelectQueryOptions const&) @ 0x0000000039a3f635 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x0000000039a3c1aa in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/executeQuery.cpp:1026: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a1ad7 in /usr/bin/clickhouse
15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
21. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:59.123148 [ 22353 ] {b03ae314-d0cc-4364-afdd-30f4defec91d} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1659242 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_123_5/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 37823): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:44:59.191156 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:59.403920 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:44:59.499920 [ 22323 ] {163da02d-954a-4c8c-9307-0540708b9fa4} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1067248 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_1_7_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:44:59.601024 [ 22324 ] {717dd128-42cb-44c8-86b0-4efb33cda65b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1902760 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (avg_value_size_hint = 137.43310546875, avg_chars_size = 155.3197265625, limit = 8192): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x000000003d526fd3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d5211b7 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:00.085050 [ 2417 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:00.085152 [ 2408 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:01.087217 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:01.087520 [ 2462 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:02.774501 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:297: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66c6ea in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:02.774804 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 2001731 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_4_4_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6214): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:02.875079 [ 22324 ] {a38e1eae-1853-4394-a438-e00c4f77474c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1057880 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50458) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:04.196868 [ 2457 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:04.196923 [ 22358 ] {d281e422-a06b-420f-b463-bfe4985a430c} <Error> executeQuery: Code: 43. DB::Exception: Second argument for function addSeconds (delta) must be a number. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50422) (comment: 02470_suspicious_low_cardinality_msan.sql) (in query: SELECT colAlias0, colAlias2, colAlias3 FROM alias_2__fuzz_25;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::FunctionDateOrDateTimeAddInterval<DB::AddSecondsImpl>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000c72d5e5 in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. DB::FunctionBinaryArithmetic<DB::PlusImpl, DB::NamePlus, true, true, false>::executeDateTimeIntervalPlusMinus(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, std::shared_ptr<DB::IFunctionOverloadResolver> const&) const @ 0x000000001b13ea49 in /usr/bin/clickhouse
9. DB::FunctionBinaryArithmetic<DB::PlusImpl, DB::NamePlus, true, true, false>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001b13bc35 in /usr/bin/clickhouse
10. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
11. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::defaultImplementationForNulls(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c0c19 in /usr/bin/clickhouse
14. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff7f in /usr/bin/clickhouse
15. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
16. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x00000000374f0465 in /usr/bin/clickhouse
18. ./build_docker/./src/Core/Block.h:35: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x000000003eba1263 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr<DB::ActionsDAG> const&) @ 0x000000003f0cea50 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr<DB::ActionsDAG> const&, String const&) @ 0x0000000039b77a1a in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b55c34 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse

2024.09.24 02:45:04.196979 [ 2413 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:04.197059 [ 22324 ] {a38e1eae-1853-4394-a438-e00c4f77474c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1057880 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
25. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
29. ? @ 0x00007fea4cb39ac3 in ?
30. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:04.197252 [ 22327 ] {b9fcf073-20bb-4a1e-8a84-e293dc7e04e6} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 0.00 B (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50474) (comment: 00072_compare_date_and_string_index.sql) (in query: SELECT count() FROM test.hits WHERE EventDate > '2014-03-18';), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:04.197268 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr<DB::IDataPartStorage> const&, String const&, String const&, String const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, std::shared_ptr<DB::ICompressionCodec> const&, unsigned long, DB::WriteSettings const&) @ 0x000000003d13f6e2 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeDataPartWriterOnDisk::Stream>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeDataPartWriterOnDisk::Stream, String&, std::shared_ptr<DB::IDataPartStorage>, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr<DB::IDataPartStorage>&&, String&, char const* const&, String&, String const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, std::shared_ptr<DB::ICompressionCodec>&, unsigned long const&, DB::WriteSettings const&) @ 0x000000003d1796ab in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d171503 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d15a863 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a3a0 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:04.199384 [ 22358 ] {d281e422-a06b-420f-b463-bfe4985a430c} <Error> TCPHandler: Code: 43. DB::Exception: Second argument for function addSeconds (delta) must be a number. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x00000000093c4755 in /usr/bin/clickhouse
3. DB::FunctionDateOrDateTimeAddInterval<DB::AddSecondsImpl>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000c72d5e5 in /usr/bin/clickhouse
4. DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000093c235f in /usr/bin/clickhouse
5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cb3cd in /usr/bin/clickhouse
6. ./build_docker/./src/Functions/IFunction.cpp:435: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352ca86a in /usr/bin/clickhouse
7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000352cc4cd in /usr/bin/clickhouse
8. DB::FunctionBinaryArithmetic<DB::PlusImpl, DB::NamePlus, true, true, false>::executeDateTimeIntervalPlusMinus(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, std::shared_ptr<DB::IFunctionOverloadResolver> const&) const @ 0x000000001b13ea49 in /usr/bin/clickhouse
9. DB::FunctionBinaryArithmetic<DB::PlusImpl, DB::NamePlus, true, true, false>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000001b13bc35 in /usr/bin/clickhouse
10. DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c6bc2 in /usr/bin/clickhouse
11. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x00000000093c64f8 in /usr/bin/clickhouse
12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c003a in /usr/bin/clickhouse
13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::defaultImplementationForNulls(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c0c19 in /usr/bin/clickhouse
14. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352bff7f in /usr/bin/clickhouse
15. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c2125 in /usr/bin/clickhouse
16. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000352c84d1 in /usr/bin/clickhouse
17. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x00000000374f0465 in /usr/bin/clickhouse
18. ./build_docker/./src/Core/Block.h:35: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x000000003eba1263 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr<DB::ActionsDAG> const&) @ 0x000000003f0cea50 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr<DB::ActionsDAG> const&, String const&) @ 0x0000000039b77a1a in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b55c34 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse

2024.09.24 02:45:04.253676 [ 22327 ] {b9fcf073-20bb-4a1e-8a84-e293dc7e04e6} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 0.00 B (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
12. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:05.034250 [ 24477 ] {9a18566c-473e-401a-8abb-1a5c5b666cf2} <Error> executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40980) (comment: 02534_analyzer_grouping_function.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:05.044502 [ 24477 ] {9a18566c-473e-401a-8abb-1a5c5b666cf2} <Error> TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<std::basic_string_view<char, std::char_traits<char>>&>(int, FormatStringHelperImpl<std::type_identity<std::basic_string_view<char, std::char_traits<char>>&>::type>, std::basic_string_view<char, std::char_traits<char>>&) @ 0x0000000015179817 in /usr/bin/clickhouse
3. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1cc5f in /usr/bin/clickhouse
4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000035e1b3de in /usr/bin/clickhouse
5. ./build_docker/./src/Access/SettingsConstraints.cpp:182: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x0000000035e1bb7b in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/Context.cpp:1899: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x00000000378a12f5 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:173: DB::InterpreterSetQuery::execute() @ 0x0000000039d96074 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
17. ? @ 0x00007fea4cb39ac3 in ?
18. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:05.078944 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1411454 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:05.112755 [ 22341 ] {742a3fc5-8897-4527-987e-d626b58f4d07} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 78 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:41170) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format TSV ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:05.200038 [ 2326 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:05.203638 [ 2341 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:08.037432 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4630045 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:08.037464 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4195582 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:08.037553 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:08.037693 [ 24493 ] {76a86778-2832-4787-a24b-e703d823dbc2} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40982) (comment: 01632_select_all_syntax.sql) (in query: SELECT sum(number) FROM numbers(10);), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:08.037826 [ 22347 ] {da60191e-c9d5-427c-b021-ec9667f22a00} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1049191 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40962) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:45:09.547749 [ 2381 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:09.547707 [ 22341 ] {742a3fc5-8897-4527-987e-d626b58f4d07} <Error> DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 78 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:09.547824 [ 2342 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:09.547908 [ 2531 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Error> void DB::CachedOnDiskWriteBufferFromFile::cacheData(char *, size_t, bool): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1400895 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:0: DB::FileSegmentRangeWriter::write(char const*, unsigned long, unsigned long, DB::FileSegmentKind) @ 0x000000003586043f in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:257: DB::CachedOnDiskWriteBufferFromFile::cacheData(char*, unsigned long, bool) @ 0x0000000035864bd8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:217: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863e42 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
19. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
21. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
22. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:09.547768 [ 22342 ] {7107e919-8414-4350-bd20-79d04a68891b} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1051008 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50430) (comment: 00170_s3_cache.sql) (in query: SELECT RegionID, uniq(UserID) AS u FROM test.hits_s3 GROUP BY RegionID ORDER BY u DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, TwoLevelHashTableGrower<8ul>, Allocator<true, true>>::alloc(TwoLevelHashTableGrower<8ul> const&) @ 0x0000000038101f4b in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/TwoLevelHashTable.h:102: TwoLevelHashTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, TwoLevelHashTableGrower<8ul>, Allocator<true, true>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, TwoLevelHashTableGrower<8ul>, Allocator<true, true>>, 8ul>::TwoLevelHashTable<HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>> const&) @ 0x00000000381c9983 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/HashTable/TwoLevelHashMap.h:0: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x0000000037db5f9f in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabd1 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:09.547945 [ 22369 ] {7967f36a-a013-42cd-ac14-3be4adc3fe2b} <Error> executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40996) (in query: select _path, _file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:09.547994 [ 22333 ] {7fcf61af-cda6-4214-922f-5411a94ac2c0} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1156216 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40968) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:45:09.548226 [ 22347 ] {da60191e-c9d5-427c-b021-ec9667f22a00} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1049191 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:45:09.548329 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ea37678b-8afe-4455-ab95-2e8eb662fcd1::202409_1_84_16}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1746046 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:09.548552 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_80_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1076696 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000a72444d in /usr/bin/clickhouse
10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector<char8_t>::insert(DB::Field const&) @ 0x000000003b27b91f in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::insert(DB::Field const&) @ 0x000000003b0dee12 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x000000003b24c1a0 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnArray.cpp:0: DB::ColumnArray::insert(DB::Field const&) @ 0x000000003ac9cd2d in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/ColumnMap.cpp:0: DB::ColumnMap::insert(DB::Field const&) @ 0x000000003b13b49a in /usr/bin/clickhouse
15. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b8d0a23 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:09.548333 [ 24493 ] {76a86778-2832-4787-a24b-e703d823dbc2} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:85: CurrentMemoryTracker::check() @ 0x00000000207abbe5 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x0000000037db2c71 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabe0 in /usr/bin/clickhouse
10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
16. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
20. ? @ 0x00007fea4cb39ac3 in ?
21. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:11.199859 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 4195600 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.cpp:0: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b1e3604 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/ColumnsCommon.h:129: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::selectIndexImpl<DB::ColumnString>(DB::ColumnString const&, DB::IColumn const&, unsigned long) @ 0x000000003b1c7729 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.cpp:267: DB::ColumnString::index(DB::IColumn const&, unsigned long) const @ 0x000000003b1c264e in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1457: DB::ColumnTuple::index(DB::IColumn const&, unsigned long) const @ 0x000000003b24f081 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnArray::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003acb65f9 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnArray.cpp:811: DB::ColumnArray::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003aca7884 in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/ColumnMap.cpp:0: DB::ColumnMap::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b13bcd5 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPartWriter.cpp:0: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d135ce2 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:166: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11e92d in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:11.200012 [ 22369 ] {7967f36a-a013-42cd-ac14-3be4adc3fe2b} <Error> TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003bc39680 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/IStorage.cpp:0: DB::IStorage::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000003ba29123 in /usr/bin/clickhouse
5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000039b6c158 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional<DB::Pipe>) @ 0x0000000039b513c1 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039b4eead in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:303: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x0000000039d8bc3b in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x0000000039d8e53a in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x000000003a995102 in /usr/bin/clickhouse
12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x000000003e0a83b8 in /usr/bin/clickhouse
13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x000000003e0ee57c in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
19. ? @ 0x00007fea4cb39ac3 in ?
20. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:11.200173 [ 22341 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:12.989123 [ 22322 ] {aa55212c-5f5f-405e-816d-9cf63c885238} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 164.23 MiB (attempt to allocate chunk of 1926287 bytes), maximum: 9.31 GiB: (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:40954) (comment: 00167_read_bytes_from_fs.sql) (in query: SELECT sum(cityHash64(*)) FROM test.hits SETTINGS max_threads=40;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:45:12.989227 [ 22333 ] {7fcf61af-cda6-4214-922f-5411a94ac2c0} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1156216 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x00000000368a682d in /usr/bin/clickhouse
10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368ae4b8 in /usr/bin/clickhouse
11. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: non-virtual thunk to DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x00000000368af62d in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b9b3 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:45:12.989318 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_1_84_15}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1172031 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:87: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d15a0b9 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d1100ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:12.989296 [ 22342 ] {7107e919-8414-4350-bd20-79d04a68891b} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1051008 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, TwoLevelHashTableGrower<8ul>, Allocator<true, true>>::alloc(TwoLevelHashTableGrower<8ul> const&) @ 0x0000000038101f4b in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/TwoLevelHashTable.h:102: TwoLevelHashTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, TwoLevelHashTableGrower<8ul>, Allocator<true, true>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, TwoLevelHashTableGrower<8ul>, Allocator<true, true>>, 8ul>::TwoLevelHashTable<HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>> const&) @ 0x00000000381c9983 in /usr/bin/clickhouse
11. ./build_docker/./src/Common/HashTable/TwoLevelHashMap.h:0: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x0000000037db5f9f in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x0000000037deabd1 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003eb1bb40 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x000000003eb12388 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:12.989523 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:12.989569 [ 2372 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:12.989674 [ 22360 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:12.989690 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:12.989857 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 2449471 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:14.025744 [ 2539 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmp67269c52-df8e-46b2-b457-77782ddca48b' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:45:14.638397 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:281: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66bd97 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:17.602019 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 4205407 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::savingThreadFunction() @ 0x000000003a42c002 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c45ea7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c45d7f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:17.602094 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4874525 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:17.602157 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 5198785 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:17.602442 [ 22335 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:17.602674 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:17.602649 [ 22322 ] {aa55212c-5f5f-405e-816d-9cf63c885238} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/vsp/pobzwebanefakiewxlegvuemfyyce, hash key: 4048e9cb6dfff8067fc78146ab9ef807, file_offset_of_buffer_end: 48581529, read_until_position: 52045196, internal buffer end: 47185920, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: aa55212c-5f5f-405e-816d-9cf63c885238:2761, file segment info: File segment: [46137344, 54525951], key: 4048e9cb6dfff8067fc78146ab9ef807, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: aa55212c-5f5f-405e-816d-9cf63c885238:2761, current write offset: 46137344, caller id: aa55212c-5f5f-405e-816d-9cf63c885238:2761, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:17.602935 [ 2462 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:17.602978 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ea37678b-8afe-4455-ab95-2e8eb662fcd1::202409_1_84_16}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:281: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d66bd97 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d663d20 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000003cde531c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::MergeProjectionsStage::subtasks::'lambda1'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf95ff in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000003cde56ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.813932 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4194515 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:0: DB::CompressionCodecMultiple::doCompressData(char const*, unsigned int, char*) const @ 0x00000000368e1fc4 in /usr/bin/clickhouse
8. ./build_docker/./src/Compression/ICompressionCodec.cpp:89: DB::ICompressionCodec::compress(char const*, unsigned int, char*) const @ 0x00000000369cf862 in /usr/bin/clickhouse
9. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:39: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b01e8 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:434: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000003d124c95 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:422: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000003d1274e5 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d6640e7 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
27. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
28. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c40767 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::AsynchronousMetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4063f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.814090 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4196157 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::HashingWriteBuffer::HashingWriteBuffer(DB::WriteBuffer&, unsigned long) @ 0x000000003cb9db60 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:65: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f647 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(std::vector<DB::TransactionsInfoLogElement, std::allocator<DB::TransactionsInfoLogElement>> const&, unsigned long) @ 0x000000003a48bd33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TransactionsInfoLogElement>::savingThreadFunction() @ 0x000000003a489022 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TransactionsInfoLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4b947 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.814269 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_81_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1443487 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.814270 [ 24260 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.814448 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.814513 [ 22322 ] {aa55212c-5f5f-405e-816d-9cf63c885238} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/vsp/pobzwebanefakiewxlegvuemfyyce, hash key: 4048e9cb6dfff8067fc78146ab9ef807, file_offset_of_buffer_end: 0, read_until_position: 5357066, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: aa55212c-5f5f-405e-816d-9cf63c885238:6104, file segment info: File segment: [0, 8388607], key: 4048e9cb6dfff8067fc78146ab9ef807, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: aa55212c-5f5f-405e-816d-9cf63c885238:6104, current write offset: 0, caller id: aa55212c-5f5f-405e-816d-9cf63c885238:6104, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bfa6a in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
23. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
27. ? @ 0x00007fea4cb39ac3 in ?
28. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.814650 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_80_89_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1264575 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.814808 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.814969 [ 2642 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4216767 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11d62d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(std::vector<DB::ZooKeeperLogElement, std::allocator<DB::ZooKeeperLogElement>> const&, unsigned long) @ 0x000000003a49e733 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::ZooKeeperLogElement>::savingThreadFunction() @ 0x000000003a49ba22 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4cbc7 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::ZooKeeperLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c4ca9f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.815027 [ 22348 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:19.815046 [ 2404 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:22.672855 [ 2587 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4201310 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
8. ./build_docker/./src/Columns/ColumnString.cpp:291: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b1e3613 in /usr/bin/clickhouse
9. ./build_docker/./src/Columns/ColumnsCommon.h:129: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::selectIndexImpl<DB::ColumnString>(DB::ColumnString const&, DB::IColumn const&, unsigned long) @ 0x000000003b1c7729 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.cpp:267: DB::ColumnString::index(DB::IColumn const&, unsigned long) const @ 0x000000003b1c264e in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1457: DB::ColumnTuple::index(DB::IColumn const&, unsigned long) const @ 0x000000003b24f081 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnArray::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003acb65f9 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnArray.cpp:811: DB::ColumnArray::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003aca7884 in /usr/bin/clickhouse
14. ./build_docker/./src/Columns/ColumnMap.cpp:0: DB::ColumnMap::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b13bcd5 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPartWriter.cpp:0: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d135ce2 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:166: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11e92d in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(std::vector<DB::OpenTelemetrySpanLogElement, std::allocator<DB::OpenTelemetrySpanLogElement>> const&, unsigned long) @ 0x000000003a409933 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::OpenTelemetrySpanLogElement>::savingThreadFunction() @ 0x000000003a406e12 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::OpenTelemetrySpanLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c439a7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:22.672937 [ 22366 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:22.673272 [ 22322 ] {aa55212c-5f5f-405e-816d-9cf63c885238} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/wvd/srbcywphyvctsghvmczwwqwovxufb, hash key: 7f71a8714536a547b366082cf641241e, file_offset_of_buffer_end: 23957860, read_until_position: 25537512, internal buffer end: 22020096, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: aa55212c-5f5f-405e-816d-9cf63c885238:3347, file segment info: File segment: [20971520, 25165823], key: 7f71a8714536a547b366082cf641241e, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: aa55212c-5f5f-405e-816d-9cf63c885238:3347, current write offset: 20971520, caller id: aa55212c-5f5f-405e-816d-9cf63c885238:3347, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:22.673385 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ac860a65-c7ac-46f7-9b65-d9351c8c648b::202409_62_67_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049535 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:22.673527 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ea37678b-8afe-4455-ab95-2e8eb662fcd1::202409_1_84_16}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.405656 [ 2382 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.405693 [ 2432 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.405830 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5099549 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.405987 [ 2585 ] {} <Error> void DB::SystemLog<DB::SessionLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5168124 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.406109 [ 22322 ] {aa55212c-5f5f-405e-816d-9cf63c885238} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/meq/uwketbolvhogtfgishrkugpkplpcm, hash key: aee322479b267fcb32357315441859aa, file_offset_of_buffer_end: 16684434, read_until_position: 23016926, internal buffer end: 13631488, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: aa55212c-5f5f-405e-816d-9cf63c885238:6853, file segment info: File segment: [12582912, 25165823], key: aee322479b267fcb32357315441859aa, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: aa55212c-5f5f-405e-816d-9cf63c885238:6853, current write offset: 12582912, caller id: aa55212c-5f5f-405e-816d-9cf63c885238:6853, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.406363 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.432336 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc22ad in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.432425 [ 2528 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_80_89_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1264575 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.432496 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ea37678b-8afe-4455-ab95-2e8eb662fcd1::202409_1_84_16}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.571744 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_81_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1443487 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.932001 [ 22322 ] {aa55212c-5f5f-405e-816d-9cf63c885238} <Error> virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/qyr/cfoonnugxuwcajmqmizuhdrlhemwf, hash key: 3c77dd3347bfe51c9ab8044354475d80, file_offset_of_buffer_end: 3558503, read_until_position: 4428745, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: aa55212c-5f5f-405e-816d-9cf63c885238:6764, file segment info: File segment: [0, 8388607], key: 3c77dd3347bfe51c9ab8044354475d80, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: aa55212c-5f5f-405e-816d-9cf63c885238:6764, current write offset: 0, caller id: aa55212c-5f5f-405e-816d-9cf63c885238:6764, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Common/Stopwatch.h:26: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x00000000357b961b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:629: DB::CachedOnDiskReadBufferFromFile::predownload(DB::FileSegment&) @ 0x00000000357b4f6b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000357bddf6 in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x00000000357bb0b3 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000003579cb32 in /usr/bin/clickhouse
19. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000003579ac9a in /usr/bin/clickhouse
20. ./build_docker/./src/Disks/IO/ThreadPoolRemoteFSReader.cpp:0: std::__packaged_task_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000003537daef in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task<DB::IAsynchronousReader::Result ()>::operator()() @ 0x0000000035377336 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda0'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003537edee in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:24.983771 [ 2535 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Warning> TemporaryFileOnDisk: Temporary path 'tmpd3770bf7-5807-4c64-befa-2a12654ee5f6' does not exist in '/var/lib/clickhouse/tmp/'
2024.09.24 02:45:25.048528 [ 22322 ] {aa55212c-5f5f-405e-816d-9cf63c885238} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 164.23 MiB (attempt to allocate chunk of 1926287 bytes), maximum: 9.31 GiB: (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000208938ad in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x0000000020891453 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
9. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b35a2 in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4adb03 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000003d4ad3e0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae1af in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse

2024.09.24 02:45:25.069835 [ 24493 ] {b345a616-609d-4b81-b49e-58cd9a2ca7d9} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1556480 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43172) (comment: 02585_query_status_deadlock.sh) (in query: select query, event_time from system.query_log where query_id = 'test_5_test_02585_query_to_kill_id_1' and current_database = 'test_5' and query like 'select%' limit 1), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:45:26.426200 [ 24493 ] {b345a616-609d-4b81-b49e-58cd9a2ca7d9} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1556480 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column query): (while reading from part /var/lib/clickhouse/disks/s3/store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/202409_1_54_8/ in table system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x0000000037018f83 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x00000000370124e4 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521104 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
28. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse

2024.09.24 02:45:26.426283 [ 22366 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.426335 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 5220545 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.426351 [ 22337 ] {f3bd313e-92cd-40b2-9cb0-18df9a29f511} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1049152 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:41022) (comment: 00164_quantileBfloat16.sql) (in query: SELECT CounterID AS k, quantileBFloat16(0.5)(ResolutionWidth) FROM test.hits GROUP BY k ORDER BY count() DESC, CounterID LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/Allocator.h:0: HashTable<unsigned short, HashMapCellWithSavedHash<unsigned short, unsigned long, TrivialHash, HashTableNoState>, TrivialHash, HashTableGrower<4ul>, AllocatorWithStackMemory<Allocator<true, true>, 384ul, 1ul>>::resize(unsigned long, unsigned long) @ 0x0000000023c3bc34 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/HashTable.h:0: DB::QuantileBFloat16Histogram<unsigned short>::merge(DB::QuantileBFloat16Histogram<unsigned short> const&) @ 0x0000000023c4a7f6 in /usr/bin/clickhouse
11. ./build_docker/./src/AggregateFunctions/AggregateFunctionQuantile.h:0: DB::IAggregateFunctionHelper<DB::AggregateFunctionQuantile<unsigned short, DB::QuantileBFloat16Histogram<unsigned short>, DB::NameQuantileBFloat16, false, double, false>>::mergeBatch(unsigned long, unsigned long, char**, unsigned long, char* const*, DB::Arena*) const @ 0x0000000023c4673d in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e8c53 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:26.426460 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr<DB::TemporaryFileOnDisk, std::default_delete<DB::TemporaryFileOnDisk>>&&) @ 0x000000003726e924 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x000000003a656bd9 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:296: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc2065 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
24. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
28. ? @ 0x00007fea4cb39ac3 in ?
29. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.426574 [ 22333 ] {c58d4bb3-8bf8-4fa2-82fe-5191229255da} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1264806 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:50232) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:26.426641 [ 2466 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.426747 [ 2346 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.427437 [ 22322 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.427448 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5138781 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::flushImpl(std::vector<DB::QueryLogElement, std::allocator<DB::QueryLogElement>> const&, unsigned long) @ 0x000000003a42ed13 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::QueryLogElement>::savingThreadFunction() @ 0x000000003a42c002 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::QueryLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c45ea7 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.435256 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d88f6a6d-9cdb-42d7-874b-d9e099182172::202409_80_89_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1264575 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.435337 [ 2530 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ea37678b-8afe-4455-ab95-2e8eb662fcd1::202409_1_84_16}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.554489 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_81_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1443487 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
17. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x000000003d1469ff in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d14629e in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c3c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cdefdd9 in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:66: std::shared_ptr<DB::MergedBlockOutputStream> std::make_shared[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool, bool&, DB::WriteSettings, void>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&, bool&&, bool&, DB::WriteSettings&&) @ 0x000000003cde7b39 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x000000003cdc56c3 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8bdf in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:26.662437 [ 22333 ] {c58d4bb3-8bf8-4fa2-82fe-5191229255da} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1264806 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:27.164545 [ 22337 ] {f3bd313e-92cd-40b2-9cb0-18df9a29f511} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1049152 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x00000000207a86d2 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/Allocator.h:0: HashTable<unsigned short, HashMapCellWithSavedHash<unsigned short, unsigned long, TrivialHash, HashTableNoState>, TrivialHash, HashTableGrower<4ul>, AllocatorWithStackMemory<Allocator<true, true>, 384ul, 1ul>>::resize(unsigned long, unsigned long) @ 0x0000000023c3bc34 in /usr/bin/clickhouse
10. ./build_docker/./src/Common/HashTable/HashTable.h:0: DB::QuantileBFloat16Histogram<unsigned short>::merge(DB::QuantileBFloat16Histogram<unsigned short> const&) @ 0x0000000023c4a7f6 in /usr/bin/clickhouse
11. ./build_docker/./src/AggregateFunctions/AggregateFunctionQuantile.h:0: DB::IAggregateFunctionHelper<DB::AggregateFunctionQuantile<unsigned short, DB::QuantileBFloat16Histogram<unsigned short>, DB::NameQuantileBFloat16, false, double, false>>::mergeBatch(unsigned long, unsigned long, char**, unsigned long, char* const*, DB::Arena*) const @ 0x0000000023c4673d in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::mergeStreamsImplCase<false, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, unsigned long, unsigned long, std::vector<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*, std::allocator<DB::PODArray<char*, 4096ul, Allocator<false, false>, 63ul, 64ul> const*>> const&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>> const&, DB::Arena*) const @ 0x00000000381e8c53 in /usr/bin/clickhouse
13. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl<DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>>(DB::Block, DB::Arena*, DB::AggregationMethodOneNumber<unsigned int, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>, true, false>&, HashMapTable<unsigned long, HashMapCell<unsigned long, char*, HashCRC32<unsigned long>, HashTableNoState, PairNoInit<unsigned long, char*>>, HashCRC32<unsigned long>, HashTableGrowerWithPrecalculation<8ul>, Allocator<true, true>>&, char*, bool, DB::Arena*) const @ 0x00000000380be569 in /usr/bin/clickhouse
14. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list<DB::Block, std::allocator<DB::Block>>&, bool) @ 0x0000000037e4f59e in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x000000003ec23c24 in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
18. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
20. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
22. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
26. ? @ 0x00007fea4cb39ac3 in ?
27. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:27.427659 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:27.427766 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:28.461444 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:28.462119 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:28.667978 [ 22360 ] {3590b82b-0a2c-4be4-af85-688de5d6ca44} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1418528 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43214) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnFixedString.cpp:339: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnFixedString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b0c887a in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnFixedString.cpp:314: DB::ColumnFixedString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08c97c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3f104 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:28.758634 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1224206 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_8_8_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6867): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:28.952401 [ 22360 ] {3590b82b-0a2c-4be4-af85-688de5d6ca44} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1418528 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnFixedString.cpp:339: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnFixedString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b0c887a in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnFixedString.cpp:314: DB::ColumnFixedString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08c97c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3f104 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:29.462359 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:29.462838 [ 2424 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:30.463207 [ 2310 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:30.463629 [ 2372 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:31.016395 [ 2540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1123860 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_4_4_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6214): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:31.050451 [ 22369 ] {1b6fc779-6710-43e1-b927-82847923123c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1301512 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43262) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnFixedString.cpp:339: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnFixedString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b0c887a in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnFixedString.cpp:314: DB::ColumnFixedString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08c97c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3f104 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:31.464260 [ 2322 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:31.464338 [ 2361 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:31.693945 [ 22369 ] {1b6fc779-6710-43e1-b927-82847923123c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1301512 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942fa38 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnFixedString.cpp:339: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::ColumnFixedString::indexImpl<unsigned long>(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b0c887a in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/ColumnFixedString.cpp:314: DB::ColumnFixedString::permute(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, unsigned long) const @ 0x000000003b08c97c in /usr/bin/clickhouse
12. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3f104 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
20. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
24. ? @ 0x00007fea4cb39ac3 in ?
25. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:32.467114 [ 2355 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:32.469218 [ 2437 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:33.091843 [ 22335 ] {98171668-cba4-4c00-ab39-beb2bfb3e780} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1263856 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43318) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:33.470221 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:33.470423 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:33.646379 [ 22335 ] {98171668-cba4-4c00-ab39-beb2bfb3e780} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1263856 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:34.472345 [ 2438 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:34.472615 [ 2423 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:35.048436 [ 2529 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Error> void DB::CachedOnDiskWriteBufferFromFile::cacheData(char *, size_t, bool): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1400895 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:0: DB::FileSegmentRangeWriter::write(char const*, unsigned long, unsigned long, DB::FileSegmentKind) @ 0x000000003586043f in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:257: DB::CachedOnDiskWriteBufferFromFile::cacheData(char*, unsigned long, bool) @ 0x0000000035864bd8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:217: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863e42 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
19. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
21. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
22. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:35.110034 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7b456c2b-5453-460f-b7e7-6072b860c476::202409_96_136_6}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 1078837 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/7b4/7b456c2b-5453-460f-b7e7-6072b860c476/202409_96_123_5/ in table system.text_log (7b456c2b-5453-460f-b7e7-6072b860c476) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 9021): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012512 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional<std::pair<String, unsigned long>>) @ 0x000000003d476a61 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d47481b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:35.123342 [ 22335 ] {df1604b6-9ee0-43c1-9975-8d05b3b0b858} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 1067248 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:43362) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:35.312008 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 2449471 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:35.473121 [ 2342 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:35.473446 [ 2381 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:35.603618 [ 2542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_81_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1150872 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:36.290467 [ 22335 ] {df1604b6-9ee0-43c1-9975-8d05b3b0b858} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 1067248 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_17_24_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:36.473831 [ 2333 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:36.474206 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:37.474825 [ 2387 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:37.475062 [ 2366 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:37.627175 [ 22335 ] {a569a83f-3280-44fd-8905-e67fc1b5ae30} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1263856 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46074) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:38.407184 [ 22335 ] {a569a83f-3280-44fd-8905-e67fc1b5ae30} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1263856 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:38.475634 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:38.476028 [ 2339 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:39.476740 [ 2455 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:39.477193 [ 2360 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:40.089511 [ 2527 ] {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1} <Error> void DB::CachedOnDiskWriteBufferFromFile::cacheData(char *, size_t, bool): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1400895 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x0000000020a16b2d in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x0000000020c74c23 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000003aaa4758 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:0: DB::FileSegmentRangeWriter::write(char const*, unsigned long, unsigned long, DB::FileSegmentKind) @ 0x000000003586043f in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:257: DB::CachedOnDiskWriteBufferFromFile::cacheData(char*, unsigned long, bool) @ 0x0000000035864bd8 in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:217: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863e42 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
19. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
20. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
21. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
22. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:40.123969 [ 22369 ] {3502de42-2f49-4322-9839-0934bc640d49} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1067248 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46104) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:40.172784 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 2449471 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x0000000035863f6a in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d172f99 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&) @ 0x000000003d167cf0 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set<String, std::less<String>, std::allocator<String>>&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1635f2 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d15cd7b in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:40.201122 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 4203709 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x0000000020a18936 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620595a in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:40.477770 [ 2388 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:40.478250 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:40.504882 [ 22369 ] {3502de42-2f49-4322-9839-0934bc640d49} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1067248 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 204 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:41.479041 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:41.579388 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:43.137863 [ 2563 ] {} <Warning> system.query_log (e36e64ab-110f-4502-a331-b4efd92a0e83): Temporary directory store/e36/e36e64ab-110f-4502-a331-b4efd92a0e83/tmp_insert_202409_115_115_0/ suddenly disappeared while iterating, assuming it was concurrently renamed to persistent
2024.09.24 02:45:44.968320 [ 2591 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 4194387 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const*, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const*) @ 0x000000003b3d8270 in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>::clone() const @ 0x000000003b425026 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::flushImpl(std::vector<DB::PartLogElement, std::allocator<DB::PartLogElement>> const&, unsigned long) @ 0x000000003a41c333 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::PartLogElement>::savingThreadFunction() @ 0x000000003a419622 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c44c27 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::PartLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c44aff in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:44.968649 [ 2358 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:44.968669 [ 2376 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:44.968761 [ 22369 ] {243e9b05-8b87-471d-9317-bf084611a296} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1188984 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:46142) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:44.968801 [ 2588 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 5234550 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/SerializationLowCardinality.cpp:0: DB::SerializationLowCardinality::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036f47322 in /usr/bin/clickhouse
13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(std::vector<DB::AsynchronousMetricLogElement, std::allocator<DB::AsynchronousMetricLogElement>> const&, unsigned long) @ 0x000000003a3d1bb3 in /usr/bin/clickhouse
31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::AsynchronousMetricLogElement>::savingThreadFunction() @ 0x000000003a3cf092 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:44.968883 [ 2586 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 5218556 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:429: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000003d4242f8 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000003d423aa7 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:228: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000003d6693d3 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000003d665f7c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:708: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d64aa84 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:44.969004 [ 2584 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 4194457 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x00000000208bc5ec in /usr/bin/clickhouse
8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper<DB::ColumnVectorHelper, DB::ColumnVector<unsigned long>>::clone() const @ 0x000000003b422c66 in /usr/bin/clickhouse
9. DB::IColumn::mutate(COW<DB::IColumn>::immutable_ptr<DB::IColumn>) @ 0x000000000a9cd8ea in /usr/bin/clickhouse
10. ./build_docker/./src/Core/Block.cpp:0: DB::Block::mutateColumns() @ 0x000000003629ab1d in /usr/bin/clickhouse
11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:169: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11ec0b in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d663352 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:580: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648e52 in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::flushImpl(std::vector<DB::MetricLogElement, std::allocator<DB::MetricLogElement>> const&, unsigned long) @ 0x000000003a3f70f3 in /usr/bin/clickhouse
25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::MetricLogElement>::savingThreadFunction() @ 0x000000003a3f41e2 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c42907 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::MetricLogElement>::startup()::'lambda'()&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020c427df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:44.968999 [ 2635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 4195806 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr<DB::ICompressionCodec>, unsigned long) @ 0x00000000368b0c5d in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr<DB::MergeTreeDataPartWriterCompact::CompressedStream> std::allocate_shared[abi:v15000]<DB::MergeTreeDataPartWriterCompact::CompressedStream, std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream>, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&, void>(std::allocator<DB::MergeTreeDataPartWriterCompact::CompressedStream> const&, DB::HashingWriteBuffer&, std::shared_ptr<DB::ICompressionCodec>&) @ 0x000000003d12f60d in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: void std::__function::__policy_invoker<void (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d128121 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000036eb5527 in /usr/bin/clickhouse
12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000036eb608f in /usr/bin/clickhouse
13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::IAST> const&) @ 0x000000003d11e5ba in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11dabd in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000003e242899 in /usr/bin/clickhouse
29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::flushImpl(std::vector<DB::TextLogElement, std::allocator<DB::TextLogElement>> const&, unsigned long) @ 0x000000003a4c3b33 in /usr/bin/clickhouse
30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog<DB::TextLogElement>::savingThreadFunction() @ 0x000000003a4c0e22 in /usr/bin/clickhouse
31. ./build_docker/./src/Common/SystemLogBase.cpp:0: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()>(DB::SystemLogBase<DB::TextLogElement>::startup()::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000020c4ec07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:45.119653 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_82_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1362176 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl<DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>>(DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>&) @ 0x000000003ef6aae5 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]<std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&>(std::__variant_detail::__visitation::__variant::__value_visitor<DB::MergingSortedAlgorithm::merge()::$_0&>&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<char8_t>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<unsigned long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, unsigned int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<signed char>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<short>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<int>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<long>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<128ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<wide::integer<256ul, int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<float>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<double>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<int>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<long>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<128ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::Decimal<wide::integer<256ul, int>>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnDecimal<DB::DateTime64>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv4>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnVector<DB::IPv6>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SpecializedSingleColumnSortCursor<DB::ColumnFixedString>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SimpleSortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursor, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl<DB::SortCursorWithCollation, (DB::SortingQueueStrategy)0>>&) @ 0x000000003eee9c13 in /usr/bin/clickhouse
13. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:133: DB::MergingSortedAlgorithm::merge() @ 0x000000003eed33ce in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform<DB::MergingSortedAlgorithm>::work() @ 0x000000003a2b9662 in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
29. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:45.140765 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1995965 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_6_6_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6826): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:45.689113 [ 22369 ] {243e9b05-8b87-471d-9317-bf084611a296} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1188984 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:45.969481 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:45.970165 [ 2411 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:46.972045 [ 2349 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:46.972092 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:47.180757 [ 24477 ] {} <Error> ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abe76 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000002109e831 in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr<DB::IHTTPContext>, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x000000003e10f18e in /usr/bin/clickhouse
9. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10cd9d in /usr/bin/clickhouse
10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
15. ? @ 0x00007fea4cb39ac3 in ?
16. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:47.198371 [ 22369 ] {645639e6-57be-4c92-a6a8-535301192eef} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1263856 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34168) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:47.312118 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {e36e64ab-110f-4502-a331-b4efd92a0e83::202409_55_82_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1146752 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000942f9c9 in /usr/bin/clickhouse
10. ./build_docker/./src/Columns/ColumnString.h:147: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x000000003b1dd63d in /usr/bin/clickhouse
11. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::createWithOffsets(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::Field const&, unsigned long, unsigned long) const @ 0x000000003b8d0d91 in /usr/bin/clickhouse
12. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::ColumnSparse::convertToFullColumnIfSparse() const @ 0x000000003b1a7079 in /usr/bin/clickhouse
13. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::recursiveRemoveSparse(COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) @ 0x000000003b1b50f7 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.cpp:0: DB::convertToFullIfSparse(DB::Chunk&) @ 0x000000003e1ab758 in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/Merges/Algorithms/IMergingAlgorithm.h:43: DB::IMergingTransformBase::prepareInitializeInputs() @ 0x000000003ee6ac32 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Merges/IMergingTransform.cpp:164: DB::IMergingTransformBase::prepare() @ 0x000000003ee6e436 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/IProcessor.h:193: DB::IProcessor::prepare(std::vector<unsigned long, std::allocator<unsigned long>> const&, std::vector<unsigned long, std::allocator<unsigned long>> const&) @ 0x0000000020f081fd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/ExecutingGraph.cpp:0: DB::ExecutingGraph::updateNode(unsigned long, std::queue<DB::ExecutingGraph::Node*, std::deque<DB::ExecutingGraph::Node*, std::allocator<DB::ExecutingGraph::Node*>>>&, std::queue<DB::ExecutingGraph::Node*, std::deque<DB::ExecutingGraph::Node*, std::allocator<DB::ExecutingGraph::Node*>>>&) @ 0x000000003e20d64d in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:270: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fd195 in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:47.351797 [ 2537 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1995965 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_6_6_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6826): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:159: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional<unsigned long>) @ 0x00000000209a25cf in /usr/bin/clickhouse
11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr<DB::ReadBufferFromFileBase, std::default_delete<DB::ReadBufferFromFileBase>>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr<DB::AsyncReadCounters>, std::shared_ptr<DB::FilesystemReadPrefetchesLog>) @ 0x000000003578d593 in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::S3ObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x00000000372b7267 in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector<DB::StoredObject, std::allocator<DB::StoredObject>> const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003585ab5e in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x0000000037319761 in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional<unsigned long>, std::optional<unsigned long>) const @ 0x000000003cbbb629 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003d4a5694 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003d4a95cd in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map<String, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>, std::less<String>, std::allocator<std::pair<String const, std::unique_ptr<DB::MergeTreeReaderStream, std::default_delete<DB::MergeTreeReaderStream>>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000003d4b316a in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker<DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003d4b3aec in /usr/bin/clickhouse
20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6ec6 in /usr/bin/clickhouse
21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
26. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd62c4 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:47.837484 [ 2583 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5168449 bytes), maximum: 15.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x00000000209a4382 in /usr/bin/clickhouse
8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000003621c174 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000036208b8e in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr<DB::S3::Client const>, std::shared_ptr<DB::S3::Client const>, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings const&) @ 0x000000003620732a in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromS3>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromS3, std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>, DB::WriteSettings&>(std::shared_ptr<DB::S3::Client> const&, std::shared_ptr<DB::S3::Client> const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>&, std::function<std::future<void> (std::function<void ()>&&, Priority)>&&, DB::WriteSettings&) @ 0x00000000372d2bf4 in /usr/bin/clickhouse
12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x00000000372b961e in /usr/bin/clickhouse
13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:98: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional<std::map<String, String, std::less<String>, std::allocator<std::pair<String const, String>>>>, unsigned long, DB::WriteSettings const&) @ 0x000000003585afb8 in /usr/bin/clickhouse
14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:732: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003736a63c in /usr/bin/clickhouse
15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:512: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003731a90b in /usr/bin/clickhouse
16. ./build_docker/./src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000003728b2e0 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000003cbbc3f9 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, String const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d11c575 in /usr/bin/clickhouse
19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec> const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d0ed25e in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr<DB::IMergeTreeDataPart> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList const&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>> const&, std::shared_ptr<DB::ICompressionCodec>, std::shared_ptr<DB::MergeTreeTransaction> const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003d6627c4 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTreeIndexGranularity.h:14: std::__unique_if<DB::MergedBlockOutputStream>::__unique_single std::make_unique[abi:v15000]<DB::MergedBlockOutputStream, std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>, bool, bool, DB::WriteSettings>(std::shared_ptr<DB::IMergeTreeDataPart>&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::NamesAndTypesList&, std::vector<std::shared_ptr<DB::IMergeTreeIndex const>, std::allocator<std::shared_ptr<DB::IMergeTreeIndex const>>>&, std::shared_ptr<DB::ICompressionCodec>&, std::shared_ptr<DB::MergeTreeTransaction>&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x000000003d6586f4 in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000003d648bd1 in /usr/bin/clickhouse
23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000003d6417ea in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003dac5bdb in /usr/bin/clickhouse
25. ./build_docker/./src/Processors/Sinks/SinkToStorage.cpp:0: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000003ee665f0 in /usr/bin/clickhouse
26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003eba09c0 in /usr/bin/clickhouse
27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x000000003eba052e in /usr/bin/clickhouse
28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x000000003eb9f96c in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:47.972990 [ 2339 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:47.973074 [ 2379 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:48.316729 [ 22369 ] {645639e6-57be-4c92-a6a8-535301192eef} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1263856 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:48.975993 [ 2377 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:48.976797 [ 2458 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:49.978811 [ 22369 ] {574456eb-3ae0-4808-8d23-6eec4513a96c} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1156216 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34188) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:49.989303 [ 2461 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:49.989390 [ 2360 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:50.794997 [ 22369 ] {574456eb-3ae0-4808-8d23-6eec4513a96c} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1156216 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093cda27 in /usr/bin/clickhouse
10. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::(anonymous namespace)::getBlockSortPermutationImpl(DB::Block const&, DB::SortDescription const&, DB::IColumn::PermutationSortStability, unsigned long, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul>&) @ 0x000000003aa3fef9 in /usr/bin/clickhouse
11. ./build_docker/./src/Interpreters/sortBlock.cpp:0: DB::sortBlock(DB::Block&, DB::SortDescription const&, unsigned long) @ 0x000000003aa3eecc in /usr/bin/clickhouse
12. ./build_docker/./src/Processors/Transforms/PartialSortingTransform.cpp:141: DB::PartialSortingTransform::transform(DB::Chunk&) @ 0x000000003ec32cc0 in /usr/bin/clickhouse
13. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002b04c961 in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x000000003e1c567e in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
17. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
19. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
23. ? @ 0x00007fea4cb39ac3 in ?
24. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:50.990305 [ 2394 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:50.990392 [ 2440 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:51.991329 [ 2335 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:51.991794 [ 2355 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:52.378260 [ 22369 ] {ba01b5bc-13cc-4688-86f5-bd745e4f2f11} <Error> executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1067584 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:34222) (comment: 00159_parallel_formatting_json_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRowWithNamesAndTypes), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:52.636933 [ 22369 ] {ba01b5bc-13cc-4688-86f5-bd745e4f2f11} <Error> TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1067584 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/558/55880761-8097-4baa-948d-326ef9391a78/201403_8_16_1/ in table test.hits (55880761-8097-4baa-948d-326ef9391a78) located on disk s3_disk of type s3, from mark 136 with max_rows_to_read = 18686): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. void DB::PODArrayBase<4ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x00000000093c88c7 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:0: DB::SerializationNumber<unsigned int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000036f9b987 in /usr/bin/clickhouse
11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d504f8b in /usr/bin/clickhouse
15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000003d5284b3 in /usr/bin/clickhouse
16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000003d521420 in /usr/bin/clickhouse
17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003d4f3b80 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x000000003d4f5a77 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:165: DB::IMergeTreeSelectAlgorithm::read() @ 0x000000003d4eb082 in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x000000003f239d6b in /usr/bin/clickhouse
21. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
24. ./build_docker/./base/base/../base/scope_guard.h:50: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003e200396 in /usr/bin/clickhouse
25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
26. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
30. ? @ 0x00007fea4cb39ac3 in ?
31. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:45:52.992179 [ 2365 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:52.992598 [ 2364 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:53.993296 [ 2456 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:53.993714 [ 2356 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:54.994790 [ 2392 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:54.994863 [ 2431 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:55.995829 [ 2421 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:55.995976 [ 2353 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:56.996637 [ 2374 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:56.996814 [ 2404 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:57.997352 [ 2352 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:57.997596 [ 2409 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:58.998081 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:58.998409 [ 2391 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:45:59.999394 [ 2343 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:00.099332 [ 2324 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:01.000328 [ 2465 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:01.100241 [ 2398 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:02.001274 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:02.101142 [ 2335 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:03.002235 [ 2450 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:03.102246 [ 2371 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:04.003153 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:04.104004 [ 2407 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:05.004072 [ 2350 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:05.104878 [ 2403 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:06.004998 [ 2342 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:06.105942 [ 2386 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:07.006377 [ 2415 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:07.107235 [ 2453 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:08.007767 [ 2460 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:08.108047 [ 2464 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:09.008690 [ 2457 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:09.108849 [ 2366 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:10.009648 [ 2416 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:10.109702 [ 2370 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:11.010856 [ 2458 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:11.110414 [ 2401 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:12.012068 [ 2452 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:12.111888 [ 2322 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:13.013018 [ 2454 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:13.112677 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:14.014172 [ 2382 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:14.113615 [ 2463 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:15.015300 [ 2367 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:15.114498 [ 2383 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:16.016133 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:16.115444 [ 2325 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:17.017280 [ 2344 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:17.116249 [ 2342 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:18.018422 [ 2376 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:18.116988 [ 2415 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:19.019537 [ 2420 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:19.117779 [ 2459 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:20.020425 [ 2330 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:20.118856 [ 2457 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:21.021532 [ 2390 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:21.119538 [ 2412 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:21.786164 [ 2112 ] {} <Warning> Application: Child process was stopped by signal 19.
2024.09.24 02:46:21.945617 [ 2112 ] {} <Warning> Application: Child process was continued.
2024.09.24 02:46:22.022779 [ 2326 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:22.120248 [ 2393 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.565303 [ 2363 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.565294 [ 2464 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.565713 [ 2532 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fc5ff1b5-b7bd-4122-8a88-50cb28f33be3::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2031616 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (avg_value_size_hint = 226.7925770727327, avg_chars_size = 262.5510924872792, limit = 6682): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/fc5/fc5ff1b5-b7bd-4122-8a88-50cb28f33be3/201403_1_1_0/ in table test.visits (fc5ff1b5-b7bd-4122-8a88-50cb28f33be3) located on disk s3_disk of type s3, from mark 23 with max_rows_to_read = 6682): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:102: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000207a1c92 in /usr/bin/clickhouse
9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000037012286 in /usr/bin/clickhouse
10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000036eb6f92 in /usr/bin/clickhouse
11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000003d4b0522 in /usr/bin/clickhouse
12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000003d4ae90b in /usr/bin/clickhouse
13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:173: DB::MergeTreeSequentialSource::generate() @ 0x000000003d4bcaed in /usr/bin/clickhouse
14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x000000003e1cd2dc in /usr/bin/clickhouse
15. ./build_docker/./src/Processors/ISource.cpp:0: DB::ISource::work() @ 0x000000003e1ccb6c in /usr/bin/clickhouse
16. ./build_docker/./contrib/llvm-project/libcxx/include/list:588: DB::ExecutionThreadContext::executeTask() @ 0x000000003e2290a2 in /usr/bin/clickhouse
17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000003e1fcfdd in /usr/bin/clickhouse
18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000003e1fbd07 in /usr/bin/clickhouse
19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000003e23797f in /usr/bin/clickhouse
20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x000000003e237bbf in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:612: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForOneColumn() const @ 0x000000003cddd35f in /usr/bin/clickhouse
22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:842: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::VerticalMergeStage::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8ed8 in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000003cde562e in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.598245 [ 2526 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {f2d26e92-dbe6-4e9b-9cdb-d0dd4dcfdd77::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.598293 [ 2535 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7804887f-a06a-4181-b80c-52f5418f1c0b::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.598310 [ 2539 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {bcbe0c5f-fd48-4302-b35f-d6aa2a0cde10::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.598328 [ 2536 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {1bca2ebe-2bec-4548-a5c0-1f971fcdffe5::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.598340 [ 2527 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {f6c44853-15cd-4cf3-a31d-f662ce4ba8fc::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.598353 [ 2538 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {572fe9cd-c0e3-46c7-a888-ee9eb3d0db62::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.599019 [ 2531 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {a7a40bd9-e45f-48f9-98db-f4eece398cd6::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.599032 [ 2533 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {3aac946b-ba36-45a8-ae7b-84383ef65a66::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:24.600076 [ 2529 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ce5636b2-9332-45cb-9428-6d797346c539::all_1_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 2293951 bytes), maximum: 15.31 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, String, long&, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x0000000020894310 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000208919fc in /usr/bin/clickhouse
4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000002089086e in /usr/bin/clickhouse
7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:0: CurrentMemoryTracker::alloc(long) @ 0x00000000207abdf5 in /usr/bin/clickhouse
8. ./build_docker/./src/Common/Allocator.h:147: Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000207a3177 in /usr/bin/clickhouse
9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x00000000209ff764 in /usr/bin/clickhouse
10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000003620a5dc in /usr/bin/clickhouse
11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:126: DB::WriteBufferFromS3::nextImpl() @ 0x00000000362093c2 in /usr/bin/clickhouse
12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x0000000035868186 in /usr/bin/clickhouse
13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
14. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000943e06c in /usr/bin/clickhouse
15. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x00000000368b0619 in /usr/bin/clickhouse
16. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x000000003cbab6c5 in /usr/bin/clickhouse
17. ./build_docker/./src/IO/WriteBuffer.h:0: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d123b45 in /usr/bin/clickhouse
18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000003d1214d0 in /usr/bin/clickhouse
19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.h:128: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const*) @ 0x000000003d11f53d in /usr/bin/clickhouse
20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x000000003d6630e9 in /usr/bin/clickhouse
21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x000000003cdd6342 in /usr/bin/clickhouse
22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker<bool ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTask::ExecuteAndFinalizeHorizontalPart::subtasks::'lambda0'(), bool ()>>(std::__function::__policy_storage const*) @ 0x000000003cdf8c1f in /usr/bin/clickhouse
23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000003cdd60ee in /usr/bin/clickhouse
24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x000000003cde474c in /usr/bin/clickhouse
25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000003dacbc3d in /usr/bin/clickhouse
26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000003ce2b64b in /usr/bin/clickhouse
27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000003ce2dbef in /usr/bin/clickhouse
28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003ce3519f in /usr/bin/clickhouse
29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x0000000020b87953 in /usr/bin/clickhouse
30. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000020b93733 in /usr/bin/clickhouse
31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000020b935df in /usr/bin/clickhouse
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:25.566038 [ 2380 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003c0bb50d in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287ddf in /usr/bin/clickhouse
5. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
7. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fea4cb39ac3 in ?
11. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:46:25.566373 [ 2435 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ed0394b7-896e-4be5-b277-95061d1921bf): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a75a2f5 in /usr/bin/clickhouse
3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000003bf43209 in /usr/bin/clickhouse
4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003c0d0174 in /usr/bin/clickhouse
5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_4, void ()>>(std::__function::__policy_storage const*) @ 0x000000003c287e9f in /usr/bin/clickhouse
6. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
8. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fea4cb39ac3 in ?
12. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:51:29.067195 [ 22369 ] {7e235da7-19c7-4335-9d97-5db5d9db4ae0} <Error> executeQuery: Code: 521. DB::ErrnoException: Cannot rename /var/lib/clickhouse/metadata/test.sql.tmp to /var/lib/clickhouse/metadata/test.sql because the second path already exists, errno: 17, strerror: File exists. (ATOMIC_RENAME_FAIL) (version 23.8.16.41.altinitystable (altinity build)) (from [::1]:39704) (in query: CREATE DATABASE IF NOT EXISTS test ), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:219: DB::throwFromErrno(String const&, int, int) @ 0x000000002084f090 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/atomicRename.cpp:0: DB::renameat2(String const&, String const&, int) @ 0x00000000370e9de8 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/atomicRename.cpp:208: DB::renameNoReplace(String const&, String const&) @ 0x00000000370e8604 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939a83c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?

2024.09.24 02:51:29.069546 [ 22369 ] {7e235da7-19c7-4335-9d97-5db5d9db4ae0} <Error> DynamicQueryHandler: Code: 521. DB::ErrnoException: Cannot rename /var/lib/clickhouse/metadata/test.sql.tmp to /var/lib/clickhouse/metadata/test.sql because the second path already exists, errno: 17, strerror: File exists. (ATOMIC_RENAME_FAIL), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ErrnoException::ErrnoException(String const&, int, int, std::optional<String> const&) @ 0x000000002085e21c in /usr/bin/clickhouse
3. ./build_docker/./src/Common/Exception.cpp:219: DB::throwFromErrno(String const&, int, int) @ 0x000000002084f090 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/atomicRename.cpp:0: DB::renameat2(String const&, String const&, int) @ 0x00000000370e9de8 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/atomicRename.cpp:208: DB::renameNoReplace(String const&, String const&) @ 0x00000000370e8604 in /usr/bin/clickhouse
6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000003939a83c in /usr/bin/clickhouse
7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000039407314 in /usr/bin/clickhouse
8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000003a9a4005 in /usr/bin/clickhouse
9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000003a9adaae in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x000000003df831ed in /usr/bin/clickhouse
11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x000000003df9048e in /usr/bin/clickhouse
12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x000000003e10d661 in /usr/bin/clickhouse
13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x0000000049d7acc0 in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: Poco::Net::TCPServerDispatcher::run() @ 0x0000000049d7bb22 in /usr/bin/clickhouse
15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000004a301e46 in /usr/bin/clickhouse
16. ./build_docker/./base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x000000004a2fec6e in /usr/bin/clickhouse
17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:350: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000004a2fbbd2 in /usr/bin/clickhouse
18. ? @ 0x00007fea4cb39ac3 in ?
19. ? @ 0x00007fea4cbcb850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:51:50.866657 [ 2113 ] {} <Warning> Application: Closed all listening sockets. Waiting for 12 outstanding connections.
2024.09.24 02:51:55.774171 [ 2113 ] {} <Warning> Application: Closed connections. But 12 remain. Tip: To increase wait time add to config: <shutdown_wait_unfinished>60</shutdown_wait_unfinished>
2024.09.24 02:52:02.661768 [ 2113 ] {} <Warning> Application: Will shutdown forcefully.
2024.09.24 02:52:06.331519 [ 26129 ] {} <Warning> Context: Server was built with sanitizer. It will work slowly.
2024.09.24 02:52:06.331799 [ 26129 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2024.09.24 02:52:06.336553 [ 26129 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2024.09.24 02:52:17.170634 [ 26129 ] {} <Warning> Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182
2024.09.24 02:52:18.232462 [ 26129 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2024.09.24 02:52:18.237069 [ 26129 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2024.09.24 02:52:18.237122 [ 26129 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2024.09.24 02:52:18.288067 [ 26397 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2024.09.24 02:52:20.017800 [ 26129 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2024.09.24 02:52:21.763700 [ 26129 ] {} <Warning> loadMetadata: Removing temporary file /var/lib/clickhouse/metadata/test.sql.tmp
2024.09.24 02:52:22.077289 [ 26129 ] {} <Warning> DatabaseReplicated (test_mz35ppxr): Database test_mz35ppxr exists locally, but its replica does not exist in ZooKeeper (/test/db/test_14/replicas/s1|r1). Assuming it was dropped, will not try to start it up
2024.09.24 02:52:22.179124 [ 26129 ] {} <Warning> TablesLoader: Tables test_15.discounts_dict depend on default.discounts, but seems like that does not exist. Will ignore it and try to load existing tables
2024.09.24 02:52:22.179292 [ 26129 ] {} <Warning> TablesLoader: Tables test_13.dict depend on default.dict_data, but seems like that does not exist. Will ignore it and try to load existing tables
2024.09.24 02:52:22.927133 [ 26524 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Removing temporary directory /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4/
2024.09.24 02:52:22.927313 [ 26524 ] {} <Warning> test_13.lwd_test (7b6dfa43-cc4c-4e1e-974f-b16e2490b692): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/7b6/7b6dfa43-cc4c-4e1e-974f-b16e2490b692/delete_tmp_tmp_mut_all_1_1_1_4/
2024.09.24 02:53:15.244920 [ 26564 ] {} <Error> ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<unsigned long&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<String>::type>, unsigned long&, String&&) @ 0x0000000009e5faf9 in /usr/bin/clickhouse
3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x0000000009e5f73c in /usr/bin/clickhouse
4. ./build_docker/./src/Common/TransformEndianness.hpp:18: Coordination::ZooKeeper::receiveEvent() @ 0x000000003fb2af6b in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb29f22 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fc946ea0ac3 in ?
10. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:15.341526 [ 26566 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:33408 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000210a3d7f in /usr/bin/clickhouse
3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000210a26a0 in /usr/bin/clickhouse
4. ./build_docker/./src/IO/WriteBuffer.h:60: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x000000003fad6b27 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperCommon.h:88: Coordination::ZooKeeper::sendThread() @ 0x000000003fb282c1 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3d972 in /usr/bin/clickhouse
7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
9. ? @ 0x00007fc946ea0ac3 in ?
10. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:15.342125 [ 26305 ] {} <Warning> test_1.zero_rows_per_granule2 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
2024.09.24 02:53:15.342176 [ 26306 ] {} <Warning> test_1.zero_rows_per_granule1 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
2024.09.24 02:53:15.342275 [ 26308 ] {} <Warning> test_kwrwlc1k.replicated_with_sampling (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
2024.09.24 02:53:15.553014 [ 26564 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:0: Poco::IOException::IOException(String const&, int) @ 0x000000004a1dd86e in /usr/bin/clickhouse
2. ./build_docker/./base/poco/Net/src/NetException.cpp:0: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000049d4608e in /usr/bin/clickhouse
3. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000049d633fa in /usr/bin/clickhouse
4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::shutdown() @ 0x0000000049d68359 in /usr/bin/clickhouse
5. ./build_docker/./base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x0000000049d7300e in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:969: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000003fb16f0f in /usr/bin/clickhouse
7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb2aa8e in /usr/bin/clickhouse
8. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
11. ? @ 0x00007fc946ea0ac3 in ?
12. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:15.776267 [ 26288 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ReplicatedMergeTreeCleanupThread): void DB::ReplicatedMergeTreeCleanupThread::run(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, String const&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String const&>::type>, char const*&&, String const&) @ 0x0000000035112b19 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000035110940 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>) @ 0x000000003fa2fc00 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&) @ 0x000000003fa2f931 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:199: DB::ReplicatedMergeTreeCleanupThread::clearOldLogs() @ 0x000000003d7d48d7 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::iterate() @ 0x000000003d7d267f in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::run() @ 0x000000003d7d0262 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ReplicatedMergeTreeCleanupThread::ReplicatedMergeTreeCleanupThread(DB::StorageReplicatedMergeTree&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003d7feb7f in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
12. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
15. ? @ 0x00007fc946ea0ac3 in ?
16. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:15.776683 [ 26286 ] {} <Error> test_1.zero_rows_per_granule1 (ReplicatedMergeTreeCleanupThread): void DB::ReplicatedMergeTreeCleanupThread::run(): Code: 999. Coordination::Exception: Coordination error: Session expired, path /clickhouse/tables/test_1/test_00926/zero_rows_in_granule/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, String const&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String const&>::type>, char const*&&, String const&) @ 0x0000000035112b19 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000035110940 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>) @ 0x000000003fa2fc00 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&) @ 0x000000003fa2f931 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:199: DB::ReplicatedMergeTreeCleanupThread::clearOldLogs() @ 0x000000003d7d48d7 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::iterate() @ 0x000000003d7d267f in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::run() @ 0x000000003d7d0262 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ReplicatedMergeTreeCleanupThread::ReplicatedMergeTreeCleanupThread(DB::StorageReplicatedMergeTree&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003d7feb7f in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
12. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
15. ? @ 0x00007fc946ea0ac3 in ?
16. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:15.776725 [ 26287 ] {} <Error> test_1.zero_rows_per_granule2 (ReplicatedMergeTreeCleanupThread): void DB::ReplicatedMergeTreeCleanupThread::run(): Code: 999. Coordination::Exception: Coordination error: Session expired, path /clickhouse/tables/test_1/test_00926/zero_rows_in_granule/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, String const&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String const&>::type>, char const*&&, String const&) @ 0x0000000035112b19 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000035110940 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>) @ 0x000000003fa2fc00 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&) @ 0x000000003fa2f931 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:199: DB::ReplicatedMergeTreeCleanupThread::clearOldLogs() @ 0x000000003d7d48d7 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::iterate() @ 0x000000003d7d267f in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::run() @ 0x000000003d7d0262 in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ReplicatedMergeTreeCleanupThread::ReplicatedMergeTreeCleanupThread(DB::StorageReplicatedMergeTree&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003d7feb7f in /usr/bin/clickhouse
10. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
12. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
15. ? @ 0x00007fc946ea0ac3 in ?
16. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:16.233483 [ 26546 ] {} <Error> ZooKeeperClient: Code: 999. Coordination::Exception: Session expired (fault injected on recv). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. DB::Exception::Exception<char const (&) [41]>(int, char const (&) [41]) @ 0x00000000151622f7 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage<char const (&) [41]>(Coordination::Error, char const (&) [41]) @ 0x000000003d976236 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1532: Coordination::ZooKeeper::maybeInjectRecvFault() @ 0x000000003fb2e16f in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:756: Coordination::ZooKeeper::receiveEvent() @ 0x000000003fb2b1b0 in /usr/bin/clickhouse
6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x000000003fb29f22 in /usr/bin/clickhouse
7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000003fb3e032 in /usr/bin/clickhouse
8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
10. ? @ 0x00007fc946ea0ac3 in ?
11. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:16.655220 [ 26305 ] {} <Error> test_1.zero_rows_per_granule2 (ReplicatedMergeTreeRestartingThread): Couldn't start replication (table will be in readonly mode): Coordination error: Connection loss, path /clickhouse/tables/test_1/test_00926/zero_rows_in_granule/quorum/status. Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/test_1/test_00926/zero_rows_in_granule/quorum/status. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, String const&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String const&>::type>, char const*&&, String const&) @ 0x0000000035112b19 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000035110940 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:542: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>, Coordination::Error*) @ 0x000000003fa31e6b in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:529: zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::Error*) @ 0x000000003fa31681 in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:0: DB::ReplicatedMergeTreeRestartingThread::updateQuorumIfWeHavePart() @ 0x000000003d930521 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:0: DB::ReplicatedMergeTreeRestartingThread::tryStartup() @ 0x000000003d929153 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:131: DB::ReplicatedMergeTreeRestartingThread::runImpl() @ 0x000000003d926f28 in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:58: DB::ReplicatedMergeTreeRestartingThread::run() @ 0x000000003d925148 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ReplicatedMergeTreeRestartingThread::ReplicatedMergeTreeRestartingThread(DB::StorageReplicatedMergeTree&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003d935ddf in /usr/bin/clickhouse
11. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fc946ea0ac3 in ?
17. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:16.655408 [ 26305 ] {} <Warning> test_1.zero_rows_per_granule2 (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it.
2024.09.24 02:53:17.079333 [ 26308 ] {} <Error> test_kwrwlc1k.replicated_with_sampling (ReplicatedMergeTreeRestartingThread): Couldn't start replication (table will be in readonly mode): Coordination error: Connection loss, path /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/quorum/parallel. Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/test_kwrwlc1k/test_00509/replicated_with_sampling/quorum/parallel. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, String const&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String const&>::type>, char const*&&, String const&) @ 0x0000000035112b19 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000035110940 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x000000003fa281e9 in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x000000003fa2732d in /usr/bin/clickhouse
6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:266: DB::ReplicatedMergeTreeRestartingThread::updateQuorumIfWeHavePart() @ 0x000000003d931f59 in /usr/bin/clickhouse
7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:0: DB::ReplicatedMergeTreeRestartingThread::tryStartup() @ 0x000000003d929153 in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:131: DB::ReplicatedMergeTreeRestartingThread::runImpl() @ 0x000000003d926f28 in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:58: DB::ReplicatedMergeTreeRestartingThread::run() @ 0x000000003d925148 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ReplicatedMergeTreeRestartingThread::ReplicatedMergeTreeRestartingThread(DB::StorageReplicatedMergeTree&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003d935ddf in /usr/bin/clickhouse
11. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fc946ea0ac3 in ?
17. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:17.079503 [ 26308 ] {} <Warning> test_kwrwlc1k.replicated_with_sampling (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it.
2024.09.24 02:53:17.525282 [ 26306 ] {} <Error> test_1.zero_rows_per_granule1 (ReplicatedMergeTreeRestartingThread): Couldn't start replication (table will be in readonly mode): Coordination error: Connection loss, path /clickhouse/tables/test_1/test_00926/zero_rows_in_granule/log. Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/test_1/test_00926/zero_rows_in_granule/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):

0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000004a1cdc69 in /usr/bin/clickhouse
1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002084c393 in /usr/bin/clickhouse
2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, String const&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String const&>::type>, char const*&&, String const&) @ 0x0000000035112b19 in /usr/bin/clickhouse
3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:484: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000035110940 in /usr/bin/clickhouse
4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:542: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>, Coordination::Error*) @ 0x000000003fa31e6b in /usr/bin/clickhouse
5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&) @ 0x000000003fa312f6 in /usr/bin/clickhouse
6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr<zkutil::ZooKeeper>, std::function<void (Coordination::WatchResponse const&)>, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x000000003d879cc2 in /usr/bin/clickhouse
7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ReplicatedMergeTreeRestartingThread::tryStartup() @ 0x000000003d92906b in /usr/bin/clickhouse
8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:131: DB::ReplicatedMergeTreeRestartingThread::runImpl() @ 0x000000003d926f28 in /usr/bin/clickhouse
9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:58: DB::ReplicatedMergeTreeRestartingThread::run() @ 0x000000003d925148 in /usr/bin/clickhouse
10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:717: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ReplicatedMergeTreeRestartingThread::ReplicatedMergeTreeRestartingThread(DB::StorageReplicatedMergeTree&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000003d935ddf in /usr/bin/clickhouse
11. ./build_docker/./src/Common/Stopwatch.h:24: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000036277c1e in /usr/bin/clickhouse
12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::BackgroundSchedulePool::threadFunction() @ 0x000000003628094e in /usr/bin/clickhouse
13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036282572 in /usr/bin/clickhouse
14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000020b7e35b in /usr/bin/clickhouse
15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x0000000020b8cf6b in /usr/bin/clickhouse
16. ? @ 0x00007fc946ea0ac3 in ?
17. ? @ 0x00007fc946f32850 in ?
 (version 23.8.16.41.altinitystable (altinity build))
2024.09.24 02:53:17.525487 [ 26306 ] {} <Warning> test_1.zero_rows_per_granule1 (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it.
2024.09.24 02:53:20.578788 [ 26399 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2024.09.24 02:53:20.590756 [ 26392 ] {} <Warning> KeeperLogStore: Raft server is not set in LogStore.
2024.09.24 02:53:20.611192 [ 26129 ] {} <Warning> KeeperLogStore: Changelog is shut down